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SUMK1ARV 


This  volume  contains  the  text  of  eleven  papers  presented  at  the  Specialist  Meeting  of 
the  Technical  Information  Panel  of  AGARD,  which  was  held  at  the  National  Library  and 
Archives  Building  in  Ottawa  on  16th  and  nth  September  1969. 

The  purpose  of  this  meeting  was  to  discuss  and  exchange  experiences  concerning  the  many 
practical  problems  that  occur  in  the  setting  up  of  an  automated  centre;  from  tlie  seeking 
of  approval  for  the  project,  to  the  commencement  of  its  vccessful  operation. 

Topics  covered  are:  the  advantages  to  be  gained  with  the  establishment  and  operation 
of  Small  Information  Centres,  the  role  of  Small  Information  Centres  in  the  NATO  community, 
assessing  toe  value  of  the  pilot  project  aiiprnach,  the  Importance  of  greater  participation 
by  the  user  both  in  the  preparation  of  better  profiles  and  in  the  provision  of  feedback 
data,  the  comparison  of  cost  and  effectiveness  of  the  operation,  assessment  and  selection 
of  hardware,  the  importance  of  training  ^d  retraining  of  personnel. 
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PREFACE 


In  recent  years  the  Technical  Information  Panel  of  AGARD  has  devoted  a  great  deal  of 
attention  to  the  autrnjation  of  information  systems.  In  particular,  the  experience  gained 
in  this  field  by  the  large  United  States  agencies  and  European  organizations  has  been 
studied  and  discussed  in  great  detail.  Smaller  centers  are  now  being  developed  and  opera¬ 
ted  in  a  number  of  the  member  countries.  The  purpose  of  chis  Specialist  Meeting  was  to 
discuss  and  exchange  experiences  in  the  many  practical  problems  that  occur  from  Ihe  seeking 
of  approval  for  an  automated  center  to  the  commencement  of  its  successful  operation  as  a 
production  unit.  It  was  Intended  to  cover  the  whole  spectrum  of  problem  types  encountered 
in  setting  up  an  automated  center,  in  a  sequence  in  which  they  might  logically  be  expected 
to  occur. 

Some  of  the  important  aspects  covered  are: 

(a)  The  advantages  to  be  gained  with  the  establishment  and  operation  of  small  informa¬ 
tion  centers. 

(b)  The  role  of  Etaall  Information  Centers  in  the  NATO  community. 

(c)  Assessing  the  value  of  the  pilot  project  approach. 

(d)  The  importance  of  greater  participation  by  tne  user  both  in  the  preparation  of 
better  profiles  and  feedback  data. 

(e)  Comparing  cost  and  effectiveness  of  the  operation. 

(f)  Assessment  and  selection  of  hardware. 

(g)  The  importance  of  training  and  retraining  of  personnel  in  order  to  remain  current 
with  the  latest  ‘Btate  of  the  Art”. 

It  was  quite  evident  from,  the  comme..ts  received,  both  verbal  and  by  correspondence,  that 
a  coherent  picture  was  presented  and  benefited  the  majority  of  the  attendees  at  the  meeting. 
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OPENING  REMARKS 


R.L.Harderosian 


Deputy  Chairman,  Technical  Information  Panel  AGARD, 
Wright-Patterson  AFB,  Ohio,  USA 


Distinguished  guests,  ladles  and  gentlemen  - 

It  gives  me  great  pleasure  to  welcome  all  of  you  on  behalf  of  the  Technical  Information  Panel  to  this 
Specialist  Meeting  on  ‘Troblems  in  Mechanization  of  Small  Information  Centres”  that  will  continue  for  the  next 
two  days.  You  will  hear  presentations  from  some  of  the  most  noted  personnel  in  the  field  of  Information 
science  from  the  various  countries  of  NATO.  We  encourage  audience  participation  in  the  form  of  questions, 
enquiries,  recommendations,  and  discussions  after  the  completion  of  each  paper. 

(Mr  Marderosian  then  introduced  the  first  speaker  Ir  the  Opening  Session,  Mr  G. Sylvestre,  who  was  followed 
by  Mr  F.R.  Thurston  and  Mr  H. A. Stolk.) 


Vi 


A  WELCOME  TO  THE  NATIONAL  LIBRARY 


Guy  Sylvestre 


National  Librarian,  OttaM,  Canada 


Mr  Chairman, 

Ladies  and  gentlemen, 

I  welcome  you  all  most  warmly  to  the  National  Library  of  Canada.  I  was  delighted  to  hear  scaetlme  ago  that 
AGARD  had  chosen  to  hold  this  meeting  of  specialists  in  this  institution,  and  I  sincerely  hope  that  you  too 
will  be  delighted  to  have  come  here  ana  that,  when  you  go  back  home,  you  will  keep  many  happy  meaiorles  of  your 
visit  to  Ottawa  and  of  your  meetlags  here  which,  I  trust,  will  be  thoroughly  successful,  thoroughly  fruitful, 
gratifying  and  enjoyable. 

When  I  looked  at  your  programme,  I  found  that  you  will  be  addressing  yourselves  to  problems  which  very  much 
exercise  our  minds  these  days.  Ihe  Natlcnsl  Library  is  not  exactly  a  small  information  centre,  but  we  do  have 
yet  to  solve  some  of  the  probleais  which  you  will  discuss  here  today  and  tomorrow.  We  now  have  under  wsy  a 
comprehensive  study,  encompassing  the  potential  benefits  of  electronic  data  processing  in  all  areas  of  activity, 
with  a  view  to  establishing  an  Integrated  information  system  in  the  Library.  This  is  not  meant  only  to  assist 
us  in  improving  our  own  housekeeping  operations,  but  it  is  hoped  that,  in  cooperation  with  other  large  research 
libraries  in  Canada,  with  which  we  exchange  technical  information,  there  will  be  established  in  this  country 
an  Integrated  network  of  libraries  providing  for  the  fullest  interchange  of  information  through  the  achievement 
of  a  large  measure  of  compatibility  of  processing  schemes,  rules  and  formats.  Such  exchanges  of  information 
are  also  taking  place  with  sl8ter*lnstltutioos  in  several  countries,  for  we  are  all  very  much  concerned  about 
the  problems  of  inputting  data  from  other  systems,  as  we  librarians  have  long  been  concerned  with  achieving 
greater  uniformity  of  cataloguing  rules  and  of  Indexing  periodical  literature  with  our  traditional  manual 
methods.  As  you  all  very  well  knu.;  compatibility,  when  it  can  be  achieved,  is  even  more  desirable  among  auto¬ 
mated  systems  than  between  manual  ones  and  it  is  gratifying  to  note  that,  although  the  situation  is  far  from 
ideal  and  if  much  remains  to  be  done  to  achieve  a  larger  degree  of  uniformity  among  information  systems,  there 
is  a  growing  recognition,  a  growing  awareness  in  the  library  world  today  of  the  mavltude  and  the  complexity 
of  the  problems  Involved  and,  it  seems  to  me,  a  genuine  desire,  I  would  even  say  a  deep  eagemeas,  on  the  part 
of  many,  to  cooperate  more  closely  than  ever  before  in  order  to  break  barriers  and  to  facilitate  and  nxpe<'ite 
the  interchange  of  information  on  a  world-wide  basis.  I  am  very  optlmlatic,  and  your  presence  here,  ladles 
and  gentlemen,  gives  evidence  of  this  readiness  and  makes  me  even  more  optimistic  in  this  respect. 

Je  ne  voudrais  pas,  aesdames  et  aessieurs,  que  vous  eroyles  que,  si  je  vous  al  iadlqud  bridvement  coMent 
ravenir  nous  prdoccupalt,  e'est  que  nous  n'aylons  rien  fait  jusqu’icl.  Nous  croyons,  en  effst,  avoir  rdussl 
pas  sal  en  trks  pau  de  teivs,  ce  qui  ne  veut  pas  dire  que  nos  proJets  ne  sont  pas  plus  ambltteux.  II  ne  faut 
pas  oubller  que  cette  BlbllothiiVie  natlonale  n' exists  que  depuis  1953  et  que  nous  ne  sosmis  dans  nos  meubles 
que  depuis  deux  ana.  Nous  publions  ddj4,  cependant,  une  bibliographic  nationals  (gil  est,  je  crola,  une  dcs 
aeilleurea  qui  aoient,  et  nous  avons  publU  d' utiles  rdpertolres  de  revues  et  de  jouraaux.  alnal  9ie  des 
blbllofraphlea.  Nous  avons  aussi  dtabli  un  catalogue  collectif  national  qui  coaprend  plus  de  10.000.000  de 
flches  reprdsentant  les  collections  de  plus  de  300  bibllothlques  canadlennea;  qui  grandit  mi  rythme  actual  de 
4,700  riches  par  jour  et  qui  nous  permet  de  local Iser  rapidement  les  ouvrages  dost  lea  chcrcheura  oat  beaoio. 
Alnsi,  I'an  dernier,  on  nous  a  demwdd  de  local  iser  81.373  titres  -  solt  use  moyenne  de  37S  par  jour  -  et  nous 
en  avons  trouvd  plus  de  64,000  au  Canada,  solt  80  pour  cent.  La  moltid  de  ccs  demandes  nous  parvlcnnent  par 
Telex  -  60  bibliothkques  canadlennea  commw  1  quent  avec  nous  par  c«  moyen  -  et  nous  leur  rdpondons  de  la  mime 
aaniirc,  ce  qui  fmclllte  et  acedUre  slngulldrwaent  les  travaax  de  nombreux  cbercbeura  dans  toutca  les  parties 
de  ce  grand  pays  qu'est  le  nOtre.  (Incidemment,  nous  soames  aussi  rellds  aux  graades  bibliothkques  madrlcaines 
et  dtrangOres  par  1VX. ) 

Q)  contribuant  alnsi  4  mettre  rapidement  4  la  disposition  des  cherchenrs  lea  resaources  des  prlnclpales 
bibllothdques  du  pays,  la  Blbllothdque  natlonale  du  Canada  est  pour  alnsi  dire  le  coeur  d'un  rdseau  dost  les 
battements  font  circulcr  le  sang  jusqu'aux  membres  les  plus  cxtrlmea,  et  tpil  permet  aussi  4  ces  mambree  de  se 
vlvifler  rdclproquement.  Cette  osmose  fdcondMitc  fait  pour  alnsi  dire  des  btbllotb4<i»es  des  vases  communicants, 
ce  qui  contribue  4  dlever  le  niveau  de  Icurs  services  reapectlfs. 

Je  e'en  excuse,  monsieur  le  prdsldent.  j'al  ddj4  4t4  trop  long,  mala  J'ai  cm  que  vous  seriex  peut-Wtre 
intdressd  4  avoir  quelque  Idde  de  ce  mie  nous  falsons.  Je  vous  soubalte  la  blenvense.  je  foimule  le  voeu  que 
VOS  travaux  soient  aussi  fructueux  que  votre  sdjocr  parmi  nous,  agrdfiile. 
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ADDRESS  or  RELCOME 


P.  R.  Thurston 


AOARO  National  Delegate 

Director,  National  Aeronautical  Establishment,  Ottawa,  Canada 


Mr  Chairman,  Ladles  and  Gentlemen,  Panel  Members,  Distinguished  Visitors  - 

I  am  delighted  to  have  this  opportunity  to  welcome  the  Members  of  the  Technical  Information  Panel  to  Canada. 

I  understand  that  there  are  representatives  from  France,  Germany,  the  Netherlands,  Portugal,  Norway,  U.  K. , 

U.S.  A.  and  Italy. 

The  last  time  Canada  was  privileged  to  be  host  to  the  technical  information  group  of  AGARD  was  in  June  1955. 

At  that  time  It  was  known  as  the  Technical  Information  and  Documentation  Committee.  However,  at  the  beginning  of 
1965  the  Committee  status  was  raised  to  that  of  Panel.  This  raised  status  gives  some  indication  of  the  increa¬ 
sing  importance  of  the  role  of  the  TIP  In  AGARD  and,  to  a  substantial  extent,  in  NATO  itself. 

We  are  particularly  happy  to  host  this  meeting  and  I  am  sure  the  Canadian  members  of  the  Panel  are  as  pleased 
as  I  am,  to  have  this  opportunity  to  return,  in  some  measure,  the  generous  hospitality  we  have  enjoyed  in  many 
other  NATO  countries. 

Hay  I  also  say  how  pleased  I  am  to  be  able  to  welcome  so  many  colleagues  from  Europe.  Canada  is  favoured  by 
being  a  close  neighbour  of  the  United  States  which  makes  the  exchange  of  visits  and  ideas  simple  and  frequent. 
However.  Canada  la  too  far  from  Europe  to  afford  many  such  interchanges.  Consequently  international  meetings 
of  this  nature  are  particularly  welcome  in  Canada  and  it  Is  ay  hope  that  our  European  friends  will  benefit  as 
much  from  being  in  Canada  as  we  will  from  having  then  with  ua. 

It  Is  a  privilege  too.  on  this  occasion,  to  be  able  to  bear  a  number  of  speakers  from  abroad  present  their 
various  approaches  to  problems  in  Information  science  and  to  learn  of  the  successes  achieved  and  to  be  warned 
against  approaches  which  have  proved  fruitless. 

The  achievements  of  the  Technical  Inforntlon  Panel  have  been  nary  and  its  function  is  such  that  it  has 
influenced  the  whole  of  AGARD.  For  example,  many  of  us  who  are  familiar  with  AGARD  reports  and  other  AGARD 
publications  may  not  have  been  aware  that  the  Technical  Information  Panel  has  played  a  aajor  role  in  the  publi¬ 
cations  prognmne.  and  contrived  the  distribution  of  these  publications  through  national  centres  in  member 
countries. 

It  is  gratifying  to  see,  f'om  the  topics  to  be  presented  today  and  tcaorrow,  that  the  Panel  has  not  been  con¬ 
tent  to  restrict  itself  to  traditional  methods  of  handling  informatinr,  which  are  not  now  sdeipiate  to  deal  with 
the  cataract  of  technical  material  flowing  out  of  the  world’ a reaearch  laboratories 

Nicb  sore  could  be  said  about  tbe  Panel.  I  will,  however,  leeve  it  to  the  Chalraan  to  tell  you  of  Ita  etae, 
accompli ahaants  and  plwa. 

I  offer  you  my  beat  wlahta  for  tha  aucceaa  of  the  l^ciallet  Meeting  her*  in  the  National  Library,  t  also 
hope  that  tbe  Hembera  of  the  Panel  will  enjoy  tbe  facilities  of  the  National  Research  Council  when  they  hold 
their  buaineas  meeting  there  later  in  the  week. 
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KEVNOTC  ADDRESS 


H.A.  Stolk 


Chairman.  Technical  Information  Panel  AGARO, 

National  Aerospace  Laboratory  (NLR).  Amstertiam,  The  Netherlands 


After  a  short  presentation  on  the  organization  and  mission  of  the  Advisory  Group  for  Aerospace  Research  and 
Development,  a  NATO  Agency  which  was  instituted  in  19S1  on  the  recommendation  of  the  late  Prof.  Theodore  von 
KirmAn,  and  in  which  the  leading  personalities  of  the  NATO  nations  in  the  fields  of  aerospace  science  and  tech¬ 
nology  are  brought  together.  Rr  Stolk  proceeded: 

The  present  Technical  Information  Panel  was  formed  in  1953  as  a  Documentation  Committee,  to  provide  service 
and  anvice  to  NATO  in  the  documentation  field  and  to  advise  the  AGARD  Panels  on  publlcatioo  problems.  With  the 
great  Increase  in  technical  and  scientific  information,  the  Committee  had  considerable  success  in  encouraging 
national  documentation  agencies  to  achieve  better  exchange  of  information,  and  to  make  it  available  to  larger 
numbers  of  NATO  research  workers.  The  problem  of  improving  the  exchange  of  infomatlcn  in  the  defence  field 
was  and  still  is  a  major  topic  of  discussion.  Though  the  recommendations  of  the  Prniel  to  this  effect  laid  down 

in  a  report  in  1962  were  subfe(iiently  approved  by  the  NATO  Council,  their  laplenentation  could  only  partly  be 

achieved,  security  regulations  and  proprietary  rights  being  the  greatest  obstacle  and  will  be  so.  for  a  long 
time  to  cone.  The  panel  being  the  only  permanent  organisation  within  NATO  concerned  with  procedures  and  ot«ra- 
tional  methods  in  the  information  field,  still  some  progress  could  be  made.  The  fact  that  the  Directors  and 
senior  officers  of  most  of  the  National  Defense  Documentation  Centres  are  personnel  aenbers  greatly  facilitated 
the  coamcnlcation  on  these  problems.  Panel  meetings  formed  a  favourable  occasion  to  get  to  know  each  other,  to 
exchange  experience  which  often  led  >  i  considerable  improvements  of  methods  and  organisation.  The  different 
problems  being  recognised  permitted  to  define  them  better  and  in  some  cases  to  attenuate  or  solve  then.  They 
also  have  contributed  to  a  direct  exchange  of  documentary  Information.  The  different  beads  of  the  armed  forcea 
information  services  speak  about  the  saaw  language  and  have  obtained  a  sort  of  common  view  of  their  work.  The 
conciusions  from  panel  discussions  have  permitted  their  centres  to  better  organise  the  collectlcn  of  national 
documents  and  consequently  to  make  them  available  to  the  NATO  community  as  a  whole.  Por  your  Infomstlon  I 
should  like  to  dwell  a  moment  on  the  duties  of  an  armed  forces  information  centre  as  its  activities  are  so  very 

closely  related  to  those  of  TIP.  Probably  the  most  important  duty  is  the  processing  of  unpubllabed  reports. 

This  includes  the  circulation  of  reports  from  the  country's  own  RRD  establishments  and  the  collection  and  circu- 
latico  of  reports  from  abroad.  I.nstructions  on  circulation  have  to  be  obtained  from  the  appropriate  authority 
and.  unless  the  circulation  la  unlialtvd.  a  close  check  has  to  be  kept  on  the  security  and  other  restrictions 
which  control  dissemination  All  the  reports  must  be  recorded  and  Indexed  and  with  a  few  exceptlcms  are 
announced  generally  in  an  abstract  Journal,  which  has  a  wide  hut  controlled  distribution  to  those  wrklng  in  the 
field.  Requests  for  copies  of  reports  which  are  subject  to  certain  limitations  must  be  demit  with  on  a  need- 
to-know  basis. 

As  has  been  said  before,  the  strength  of  the  Panel  is  largely  due  to  the  support  given  by  the  heads  of  various 
centres  who  have  done  much  to  improve  the  eichingea  of  report  literature  hetwsen  RATO  countrtea.  The  value  of 
pcraonal  contact  between  the  staff  of  Iht  varioua  national  centrea  can  hardly  be  undereat tmated  and  thla  has 
done  much  to  increase  efficiency.  Brceuse  the  cmntres  desi  with  the  whole  of  defence  literature,  s  very  vast 
field  indeed,  the  Panel  is  able  to  assist  NATO  both  in  snd  outside  the  ACARP  lisitstlons  of  aerospace  The 
centres  thus  cm  he  sn  extremely  laportmnt  source  of  infornmtion.  Though  thvir  main  effortn  are  available 
to  those  rslsted  to  defence,  service  will  in  many  cases  h'  provided  to  those  outside  this  field. 

To  speak  of  the  work  of  the  Psoel.  it  is  necesssry  to  be  selective  sad  the  following  itesis  will  probably  be 
of  interest:  The  Panel  hat  sssisted  three  countries,  thsi  is  Tbrhey.  <h-eect  and  Portugal,  iliich  mtrt  Intersatad 
in  setting  up  documentstion  centres  hr  sppolntinf  TIP  specislists  to  visit,  determine  the  local  problems  mid 
sdvtse  On  the  scale  mtd  orgsnlsation  of  the  unit  required,  bprcislly  the  efforts  by  Turkey  imd  tartugal  huve 
aide  a  crest  deal  of  progreaa. 

An  cxwiaatian  of  the  posatbility  of  atendardlsing  docamamtary  procedure  has  had  limited  socceaa  end  !•  onm- 
tinning.  Little  difficulty  la  experienced  at  present  by  lack  of  uniformity  but  the  spread  of  mechwimstioa 
offers  opportunities  shich  can  only  t*  fully  retlised  by  siuadsrdisaticm.  This  gives  an  opportunity  to  solve 
the  problems  of  methods  rntd  their  coapstibiilty.  Think  only  of  the  exchange  of  aagmeltc  tapes,  of  the  nilllas- 
tion  of  the  same  vocabulary,  mtd  you  will  see  how  this  could  fucilitate  the  irwsfer  of  information. 

Bibliographies,  listing  the  published  end  unpublished  literature  in  certain  technical  fields,  have  beta  pre¬ 
pared  for  AttARO  tectaical  pwela.  Itrst  of  the  national  mMbert  of  TIP  have  rontributed.  so  the  coverage  is 
better  thma  could  be  achieved  by  sny  single  person  or  organisstlon 


Ttie  Panel  prepared  and  produced  the  AGARD  Dultl>llnRual  dictionary  of  aeronautics  in  nine  lancuages  and  a 
glossery  of  terms  on  documentation. 

Over  the  years  the  Panel  has  discussed  storage  and  retrieval  of  informaticn  and  in  1968  a  Joint  symposium 
was  held  in  Munich  with  the  Avionics  Panel  to  provoke  a  user-supplier  Jialogue  in  this  field.  In  fact,  the 
symposium  was  held  principally  for  the  benefit  of  scientists  and  engineers  who  use  information  services  and  who 
would  participate  in  a  user-supplier  dialogue  on  the  present  state  of  the  art  and  the  basic  design  of  future 
systems  The  main  object  was  not  fully  achieved  however.  Either  the  users  were  not  present  in  any  considerable 
numbers  or  if  present  they  did  not  contribute  very  much  to  the  discussion.  Tb  pursue  the  dialogue  and  to  inform 
a  still  greater  number  of  users  in  NATO  of  the  present  possibilities  and  those  in  the  near  future,  a  lecture 
series  to  be  held  in  1970  was  proposed  and  approved  by  the  NDB.  Invitations  thus  far  have  been  received  tro. 
Norway  and  Italy.  The  lecture  series  is  intended  to  give  the  users  an  overall  briefing  of  the  situation  in  the 
field  of  information  and  to  provide  at  the  same  time  a  forum  for  a  broad  exchange  of  views  between  Information 
people,  scientists  and  engineers. 

Though  the  difficulties  to  get  something  accomplished  internationally  are  great,  the  panel  nevertheless  feels 
that  its  efforts  have  already  contributed  much  to  the  solution  of  many  conmion  problems  in  the  various  NATO 
countries  in  the  defence  documentation  field. 


X 


p/iPEa  1 


OBTAINING  MANAGEMENT  ACCEPTANCE  OP  A  SYSTEM  PROPOSAL 


by 


A. C. Jones 


Director,  Defence  Scientific  Information  Services, 
Defence  Research  Board,  Ottawa,  Canada 


1 


SUMMARY 


Tbe  psper  suggests  the  steps  necessary  to  prepare  an  autonated  infomatlon  retrieval 
systesi  proposal,  to  obtain  data  for  Justification  of  the  proposal  and  to  present  it  for 
final  approval.  The  need  is  stated  for  the  Inforsiatlon  centre  to  be  itself  convinced  that 
it  has  the  best  proposal  to  offer,  before  it  can  legitimately  expect  to  receive  approval. 
The  higher  nanagenent  may  need  to  be  shoan  shat  the  information  centre  has  been  doing  and 
afaat  its  customers  want,  before  examining  the  new  proposal.  The  paper  touches  on  the 
difficult  question  of  evaluating  any  information  system,  but  emphasises  the  ImpractiC'- 
ability  of  retaining  a  manual  system  when  the  raw  material  for  processing  is  going  to  be 
provided  in  machlneable  form.  Finally,  it  urges  a  team  approach  to  preparing  and  presen¬ 
ting  the  proposal,  and  holding  the  team  together  for  follow-up  on  points  requiring  further 
resolution . 


SOMMAIRE 


L*  auteur  indique,  &  tltre  de  suggestion,  les  demarches  qui  s’ Imposent  lorsqu’on  veut 
preparer  une  proposition  de  syst^me  de  recherche  d’ Information  automati-s^,  obtenlr  les 
donates  justlfiant  cette  proposition,  et  la  presenter  pour  approbation  definitive.  II 
souligce  la  necesslte,  pour  le  centre  d’ informations,  d’etre  lui-mSme  convalncu  que  la 
proposition  qu'll  soumet  est  la  meilleure,  avant  de  s’attendre  legitimement  k  ce  qu’elle 
soit  acceptee.  Avant  d’ examiner  la  nouvelle  proposition,  il  se  peut  que  les  cadres  sup^- 
rleurs  de  la  direction  alent  besoln  de  savolr  ce  que  le  centre  d’ information  a  realise, 
et  ce  que  deslrent  ses  utllisateurs.  L’ auteur  aborde  le  problems  deiicat  que  soul^ve 
1* evaluation  de  tout  systeme  d’ informations,  mais  souligne  1’ Impossibilite  de  garder  un 
systeme  manuel  lorsque  la  matiere  premiere  &  traiter  doit  etre  foumle  sous  une  forme 
propre  e  un  traitement  mecanlque.  Bifin,  il  recommande  vivement  la  constitution  d’une 
equipe  pour  preparer  et  presenter  la  proposition,  et  le  maintien  de  cette  equipe  pour 
r etude  des  probiemes  ulterieurs. 
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OBTAINING  MANAGEMENT  ACCEPTANCE  OF  A  SYSTEM  PROPOSAL 

A.  C.  Jones 


INTRODUCTION 

Obtaining  the  formal  approval  of  your  higher  managenent  is  not  of  course  the  first  thing  you  have  to  do  to 
get  a  new  information  system  into  being,  but  it  is  the  most  vital  step.  It  has  to  be  preceded  by  a  good  deal 
of  work  to  prepare  the  system  proposal.  This  work  either  requires  extra  money  and  help,  or  else  diverts  these 
from  the  normal  activity  of  your  information  centre.  In  either  case  you  will  need  some  form  of  approval  in 
principle,  or  at  least  sympathetic  understanding  from  your  mannsement  and  your  customers  rhile  you  are  doing  it. 
The  work  itself  must  be  carried  out  with  two  objectives,  one  to  devise  the  best  system  that  seems  feasible,  the 
other  to  present  the  proposal  in  such  a  way  that  it  is  accepted  by  your  organisation.  In  other  words,  you  must 
make  a  good  plan,  and  you  must  sell  it.  My  assignment  is  to  talk  about  the  selling  process,  and  from  now  on 
the  objective  I  shall  be  referring  to  is  that  of  selling  the  proposal. 

We  in  DSIS  have  been  going  through  the  system  development  process  during  the  past  three  years,  and  the 
experience  we  have  had  is  the  basis  for  this  .alk.  Circumstances  alter  cases,  so  the  best  I  can  hope  for  is 
that  some  of  the  lessons  we  learned  may  be  useful  to  you.  They  are  offered  in  that  spirit. 


GENERAL  EXPERIENCE 

You  are  not  going  to  hear  any  great  secrets.  We  made  no  great  discoveries,  but  just  learned  onca  again  that 
there  is  no  substitute  for  hard,  painstaking  preparatory  work,  and  that  this  work  must  be  planned  to  meet  its 
obj ective. 

Are  there  any  general  guides  to  follow?  There  is  certainly  one  we  could  have  learned  from  any  good  salesman, 
namely,  that  you  must  have  confidence  in  your  product  before  you  can  successfully  and  honestly  sell  it  to  others. 
You  must  be  completely  satisfied  with  your  proposal  before  you  put  it  up  for  approval  or  you  may  either  not  sell 
it,  or  perhaps  live  to  regret  that  you  did.  Your  managenent  cannot  re-examine  all  the  detailed  studies  you  will 
have  made  in  formulating  your  proposal.  They  will  have  to  take  most  of  it  on  faith  ~  faith  in  you!  u  should 
be  your  own  severest  critic. 

A  second  general  guide  we  could  have  learned  from  any  military  staff  officer.  Get  all  the  intelligence  you 
can  about  your  target.  First,  what  does  your  management  need  to  have  in  any  proposal;  what  d'les  it  like  to 
have;  how  and  when  is  a  proposal  best  presented?  What  kind  of  questions  are  usually  asked  alter  a  presentation, 
by  which  members  of  the  management  with  what  interests  in  mind?  When  you  have  collected  answers  to  these,  and 
other  similar  questions  that  will  quickly  come  to  mind  in  your  own  organisation,  examine  every  facet  of  your 
proposal  in  their  light.  This  should  tell  you  which  points  will  score  and  which  ones  would  miss  the  target. 


APPROACH  TO  MANAGEMENT 

As  we  now  see  it,  the  rest  is  a  function  of  detailed  analysis  of  the  problem  itself,  of  possible  solutions 
and  of  presenting  the  solution  you  have  selected.  But  first,  does  your  management  really  know  what  you  have  to 
do  now?  Do  they  know  who  your  users  are,  what  special  needs  they  have,  how  many  different  kinds  and  forms  of 
Information  have  to  be  handled?  Do  they  know  what  methods  you  already  use,  what  skills  your  personnel  have  to 
have,  wtiat  complexities  are  Inherent  in  the  present  system? 

Probably  not.  In  any  organisation  with  a  technical  function  such  as  ours,  the  bulk  of  the  information  we 
.andle  is  technical,  and  higher  manageme.it  is  one  place  where  no  one  has  much  time  available  to  keep  up  with 
technical  literature.  So  management  may  be  the  centre’s  poorest  customer,  and  therefore  won't  know  the  present 
system  from  direct  experience. 

Can  they  be  expected  to  fully  appreciate  your  new  proposal  under  these  circumstances?  It  would  be  unrealistic 
to  expect  this,  and  unfair  to  your  proposal  to  hazard  It  in  such  a  gamble.  You  must  try  to  educate  them. 

Perhaps  you  can  do  this  at  the  same  time  as  you  present  your  proposal.  We  decided  against  doing  that  -  It 
seemed  too  big  a  bite  with  too  little  time  for  digesting  It.  We  were  fortunate  In  being  granted  two  opportuni¬ 
ties  to  brief  our  management,  several  weeks  apart,  and  several  months  before  presenting  our  full  proposal  (a 
four-year  plan).  We  told  them  what  volume  and  k’’ds  of  material  we  handled,  what  volume  of  material  was 
Involved  in  each  of  the  regular  services  we  were  providing.  We  tried  to  devise  measures  of  the  effort  that  had 
to  go  into  meeting  various  requests  for  searches,  and  then  presented  data  based  on  these  measurements.  We 
showed  the  relative  extent  to  which  he  various  services  were  used  by  customers  In  different  categories,  the 
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categories  being  chosen  in  terns  meaningful  to  managenent,  the  is  adninistratively  meaningful.  We  showed  how 
our  personnel  were  deployed,  and  how  we  used  the  money  presently  allotted.  We  were  lucky  to  be  able  to  borrow 
an  operational  researcher  with  experience  in  studying  and  costing  flow  processes.  He  did  a  complete  study  of 
our  operation,  which  provided  a  basis  for  that  aspect  of  our  briefing  to  management. 

All  this  material  '-'ll  have  taken  many  weeks  or  months  to  compile.  It  will  almost  certainly  pay  off. 
Management  would  have  asked  most  of  those  questions  anyhow,  and  your  credibility  will  be  much  higher  if  you 
already  have  the  answers.  Incidentally,  we  learned  a  great  deal  more  about  our  own  operations  by  this  means, 
and  discovered  some  ways  of  improving  them. 

The  products  of  information  work,  an  announcement,  an  SDl  service,  a  bibliography,  a  few  reports  supplied 
against  a  search  request,  seem  quite  simple  in  themselves.  Higher  management  doesn’t  necessarily  understand 
how  complex  are  the  processes  that  produce  these  end  results,  nor  the  Intellectual  effort  U*at  goes  into  them. 

It  is  worth  a  major  effort  in  the  briefing  process  to  get  this  idea  across.  We  tried  various  ways  such  as  flow 
charts,  breakdowns  of  Job  descriptions,  and  of  work  assignments.  Individually,  none  of  these  seemed  very 
effective,  collectively  they  may  have  had  some  Impact. 

The  organisations  in  which  our  information  centres  operate  have  many  reasons  for  cheir  existence.  Service 
to  a  body  of  customers  is  often  quite  a  small  or  even  a  non-existent  element  of  their  mission.  The  higher 
management  therefore,  may  not  be  service-oriented.  The  information  centre  has  to  be  -  there  is  no  justification 
for  its  existence  except  service  to  its  users.  Implicit  In  a  service  operation  is  the  guarantee  of  maintenance 
of  high  standards  of  quality,  timeliness,  and  overall  reliability.  Other  kinds  of  operation  can  vary  their 
output  to  suit  their  internal  needs.  A  service  operation  must  provide  its  output  to  suit  its  customers’  needs. 
If  you  can  get  this  point  clearly  established  with  your  management,  you  will  save  many  future  pains.  We  tried 
to  stress  this  in  briefings,  but  we  have  found  that  our  customers  can  make  this  point  more  effectively  than  we 
can,  provided  they  direct  their  complaints  to  the  management  and  not  to  the  information  centre. 


THE  MAIN  PROBLEM 

Hanagemoit  now  knows  what  you  are  doing,  and  why.  The  next  step  is  to  explain  why  you  must  change  a  lot  of 
this.  Everycce  has  heard  of  the  information  explosion,  but  facts  and  figures  to  show  how  it  affects  your  own 
information  centre  are  necessary.  We  would  have  liked  to  present  at  least  two  aspects:  that  does  the  steady 
growth  in  volume  of  relatively  unselected  information  cost  our  customers  in  terms  of  the  effort  they  have  to 
expend  on  information  searching;  what  would  continuation  of  our  present  system  mean  in  terms  of  annual  increase 
of  Information  staff  and  money  to  handle  the  increasing  volume?  These  two  considerations  should  give  some 
indication  of  the.  scope  of  change  which  the  organisation  could  afford  to  consider,  in  respect  of  allocation  of 
resources  to  a  new  Information  system.  We  were  unable  to  do  very  much  at  the  time  lu  assess  the  burd^^n  on  the 
customers,  but  greater  efforts  to  study  thio  might  be  profitable.  We  were  of  course  able  to  provide  a  forecast 
of  our  own  internal  burden  and  its  growth  rate. 

One  further  and  very  important  consideration  -  can  we  really  go  on  using  old  methods?  Not  only  is  the 
volume  of  information  increasing  but  the  form  in  which  it  is  available  is  changing.  If  you  can  handle  it 
directly  in  these  newer  forms,  there  is  a  substantial  saving  in  effort  to  be  had.  Soon  you  may  be  unable  to 
get  much  of  the  Information  in  paper  form,  and  it  will  cost  extra  time  and  money  to  convert  it  back  into  paper 
BO  that  it  can  be  handled  b;.  the  old  methods. 

Thus  there  are  two  major  selling  points  to  emphasise; 

(a)  the  cost  is  going  up  even  if  you  stick  to  the  old  system; 

(b)  the  old  system  is  going  to  become  impracticable  to  maintain. 


THE  CHOICE  OF  SOLUTION 

You  will  have  many  things  to  consider,  but  hopefully  you  will  have  a  good  deal  of  expert  help  in  deciding 
what  to  propose  as  a  solution  to  the  problem.  Ky  only  contribution  is  to  suggest  how  it  might  be  presented. 

The  previous  indoctrination  should  have  paved  the  way  for  the  proposal.  If  necessary,  indoctrination  should 
have  been  held  back  until  the  form  the  proposal  would  take  was  sufficiently  clear  that  it  could  fulfil  that 
purpose. 

The  proposal  will  describe  the  problem  and  the  nature  of  the  solution  proposed.  Beyond  the  obvious  require¬ 
ment  for  this  to  be  logical,  reasonable,  and  understandable,  the  main  question  for  the  management  will  be  “can 
wo  afford  it?". 

We  put  the  proposal  in  the  form  of  resources  wanted,  manpower  and  money,  and  when  required.  It  clearly 
indicated  the  total  resources  required,  as  well  as  annual  amounts,  and  showed  what  existing  resources  would  be 
phased  out  as  they  were  replaced  by  elements  of  the  new  system.  The  terms  used  to  explain  this  should  allow 
management  to  weigh  up  your  demanda  against  those  from  other  branches  of  the  organisation,  without  frustrating 
difficulties.  In  our  case,  management  had  recently  instituted  a  procedure  to  do  this,  and  we  merely  followed 
that  procedure. 
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llie  presentatioQ  must  show  wbat  the  organisation  is  to  get  out  of  it.  We  shouldn’t  try  to  claim  that  great 
savings  will  accrue  -  they  won’t.  It  is  difficult  to  present  valid  cost-benefit  arguments,  because  it  is  still 
impossible  to  place  a  muney  value  on  information  work  as  a  whole.  An  occasional  case,  yes.  Generally,  no.  It 
is  possible  to  demonstrate  cost-effectiveness.  Ihe  new  system  will  be  able  to  handle  more  Jobs,  do  them  faster 
with  less  drudgery,  do  many  Jobs  the  old  system  couldn’t  handle  at  all,  do  everything  more  frequently,  and 
provide  data  for  process  control  without  the  costly  maintenance  of  statistics  by  clerical  means. 

In  other  words  it  is  possible  to  show  that  - 

(a)  you  will  be  able  to  beat  the  explosion  problem, 

(b)  you  will  be  able  to  give  a  better  service  without  significantly  greater  demands  on  future  resources 
than  you  would  have  had  to  make  if  the  old  system  were  kept. 


MECHANICS  OF  PRESENTATION 

Just  a  few  words  on  handling  the  presentation.  You  will  have  accumulated  lots  of  data,  but  pick  out  only  the 
significant  material.  Present  this  visually  if  possible,  but  only  if  good  quality  reproduction  is  available. 

Use  a  team  approach  if  you  can.  Let  the  people  who  helped  prepare  the  proposal  share  in  its  presentation.  You 
will  do  a  better  Job  of  presenting  your  case,  and  you  will  have  the  experts  with  you  to  answer  the  searching 
questions  -  better  answers  than  you  might  have  given  on  your  own.  Keep  the  presentation  as  short  as  you  can. 
Your  management  have  lots  of  other  problems  to  consider,  and  it  won’t  help  your  case  to  try  to  oversell  it. 

Have  your  complete  presentation  available  in  written  and  tabular  form  as  well.  It  is  almost  sure  to  be  needed 
in  both  forms  at  some  time. 


FINAL  CONSIDERATION  ^ 

A  final  word  of  warning.  Don’t  sit  back  and  wait  for  the  big  day  of  the  presentation.  It  is  unlikely  that 
you  will  get  either  a  yes  or  no  answer.  A  more  likely  outcome  is  a  conditional  yes;  that  is,  the  plan  seems 
acceptable,  but  would  you  please  examine  certain  points  and  provide  a  supplementary  brief.  If  you  could  guess 
in  advance  what  these  points  might  be,  you  would  have  tried  to  include  them  in  the  original  brief.  Therefore 
they  should  be  unexpected.  Try  to  hold  your  study  team  together  until  after  the  presentation,  so  that  you  can 
quickly  swing  them  into  action  to  collect  or  analyse  data  relevant  to  these  additional  questions,  and  provide 
the  answers  before  management  have  forgotten  the  original  presentation. 

If  it  sounds  as  though  we  had  all  these  ideas  worked  out  in  advance,  it  is  not  so.  He  groped  our  way  into 
some,  we  stumbled  over  others,  and  we  only  understood  certain  ones  by  analysing  them  after  the  event.  But  if 
by  presenting  them  now  we  have  saved  you  some  of  our  wasted  efforts,  our  experience  will  have  paid  for  Itself. 


PAPER  2 


EXPERIENCE  WITH  A  PILOT  SCHEME  AND 
THE  TRANSITION  STAGE  TO  PULL  MECHANISATION 


by 


S.  C.  Schuler 


Head,  TIL  Reports  Centre.  Productivity  Services  &  Information  Division, 
Ministry  of  Technology,  Orpington,  UK 
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SUMMARV 


Discusses  changes  In  operations  and  some  of  the  problems  occurring  In  the  transition 
from  purely  manual  operation,  through  partial  mechanisation,  to  a  proposed  comprehensive 
computer  system  In  an  organisation  handling  46,000  new  titles  annually.  Partial  mechanisa¬ 
tion  has  Involved  the  Introduction  of  tape  typewriters  for  typing  bibliographic  data  and 
the  production  of  printed  Indexes  from  these  data  using  a  bureau  computer.  The  comprehen¬ 
sive  system  requiring  an  "In  house"  computer  will  permit  SDI,  subject  searching,  announcement 
bulletin  and  Index  production,  and  stock  control  to  be  carried  out. 


SOMMAIRE 


L*  auteur  ddcrlt  les  modifications  de  fonctlonnement  et  les  probldmes  survenus  au  Centre 
des  Rapports  du  TIL,  au  cours  de  la  phase  de  transition  entre  operations  mahuelles  et  un 
proJet  de  aystime  complet  d' ordlnateur,  en  passant  par  une  mecanlsatlon  partlelle.  Ce 
Centre  est  une  organisation  aasez  l^tortante  traltant  des  rapports  de  recherche  et  de 
ddveloppement  aolt  llbrement  accesslbles  au  public  solt  classifies;  le  stock  de  rapports 
alnsl  traltes  s'dlive  i  presque  un  deml-allllon  par  an,  et  augmente  annuellement  de  46.000. 

Cest  par  le  systiae  manuel  que  s'effectuent  I'acqulsltloo  et  la  distribution  des  rap¬ 
ports,  et  I'annonce  de  leur  parutlon  dans  un  bulletin  bl-mensuel  alnsl  que  dans  les  listes 
speclallsees;  c'est  egalement  manuellement  que  fonctlonne  un  service  d’ Informations  tech¬ 
niques  fournlasant  des  listes  de  references  en  rdponse  i  des  demandes  speciflques,  et  des 
bibliographies  de  rapports  traltant  de  sujeta  d’  Intdrlt  gendral  et  aetuel. 

Le  premier  atade  de  la  mecanlsatlon  a  Ispllque  1’  introduction,  dans  le  cycle  de  tralte- 
nent  des  rapports,  de  quatre  perforatrlces  sur  bandes  utllisdes  pour  Inscrlrr  les  prlncipalea 
donnees  blbliographlquea  de  cheque  rapport  dans  la  preparation  dea  bulletins  d’aamonce.  La 
bands  perforee  alnsl  produite  eat  traltee  par  un  bureau  d'ordtnateurs  en  vue  de  I'etabllsse- 
ment  d' Index  Ivrimea.  L' etablisaement  de  ces  Index  a  permls  de  repondre  i  un  besoin  des 
usagers  et  de  reduire  cons Iddrabl ament  le  classement  des  fichea  dans  lea  divers  Index  de 
references. 

Le  atade  final  de  mecanlsatlon  consistera  en  1' Inatallatloo  d'un  ordlnateur  au  aeln  du 
Centre.  Cette  installation  a  dejl  M  autoriade.  Le  ajrateme  ooivlet  permettra  d’effectuer 
touts  un-  gamme  d* operations;  diffusion  selective  de  r Information,  recherchea  par  sujet, 
prepari  ja  des  bulletins  algnaietiques  et  des  index  laprlmea,  et  coatrdle  dea  stocks. 


EXPERIENCE  WITH  A  PILOT  SCHEME  AND 
THE  TRANSITION  STAGE  TO  FULL  MECHANISATION 

S.  C.  Schuler 


1.  INTRODUCTION 

During  the  past  four  years,  pilot  studies  have  been  aade  on  the  benefits  to  be  gained  froa  using  a  compre¬ 
hensive  computer  system  for  document  handling  and  retrieval  procedures  at  TIL  Reports  Centre  of  the  Ministry 
of  Technology  (Hlntech).  These  studies  have  led  to  the  introduction  of  some  first  phase  mechanisation  and  the 
use  of  a  computer  bureau  for  the  production  of  printed  indexes  to  the  report  collection.  The  decision  to  go 
ahead  with  the  procurement  of  a  computer  was  recently  made  and  this  paper  describes  the  pilot  schemes  and  the 
transition  stage  now  reached  prior  to  full  mechanisation. 


2.  FUNCTIONS  OF  TIL  REPORTS  CENTRE 

The  Centre  Is  Hlntech' s  clearing  house  for  unpublished  report  literature  and  its  main  functions  are:- 

(1)  To  exploit  the  large  collections  of  unpublished  reports  on  Science  and  Technology,  both  British 
and  overseas. 

(11)  To  meet  the  technical  Information  needs  of  Hlntech,  of  other  Government  Departments  (particularly 
the  Hlnistry  of  Defence),  and  their  Contractors,  and  other  sectors  of  British  industry. 

(Ill)  To  operate  technical  information  exchange  agreements  with  the  USA,  the  Commoowealtb  and  NATO 
countries. 

The  organisation  of  the  Centre  is  shown  In  Figure  1  and  this  Includes  some  statistics  relating  to  Its  overall 
operations.  It  will  be  seen  that  the  stock  of  reports  is  close  on  a  half  million  titles  and  Is  growing  at  the 
rate  of  20,000  per  year -in  hard  copy  and  slightly  more  for  reports  on  microfiche.  The  reports  are  available  oo 
loan  to  users  or  for  retention  for  the  cost  of  reproduction. 

The  ala  of  the  Centre  Is  to  collect  all  reports  likely  to  be  of  Interest  to  its  varied  range  of  customers  and 
to  make  them  as  widely  available  as  possible.  This  is  done  through  three  basic  services:  regular  publication  of 
abstracts  and  lists  of  material  collected,  distribution  of  a  series  of  leaflets  on  specific  items  of  technical 
innovatiMi  under  the  title  Techltnk,  and  a  technical  inquiry  service  which  Includes  the  compiling  of  biblio¬ 
graphies  to  customers’  requirements. 

The  major  publication  of  the  Reports  Centre  is  *lt  •  p  Abstracts".  This  is  a  twice-monthly  accessions  Journal 
containing  abstracts  of  the  reports  received  at  the  Centre.  The  subject  coverage  of  the  Journal  ia  classified 
into  22  CQ6ATI  subject  fields.  It  is  prepared  In  various  editions  and  an  unlimited  edition,  listing  on  average 
300  openly  available  reports,  is  on  sale. 

The  reporU  announcement  service  is  complemented  by  the  Techlink  service  which  provides  a  rapid  and  selec¬ 
tive  communication  of  information  on  new  ideas,  equipment  processes  and  matcrtala  to  individuals  ia  British 
industry  A  one  or  tmn  page  leaflet  "Tech! ink"  (an  example  is  shown  in  Figure  2)  contains  the  essentials  of  a 
particular  technical  lenovstion.  The  naterial  is  gathered  from  the  Centre’s  .-ollectioo  of  reports,  from  the 
ttaited  lingdom  Atomic  thergy  Authority,  the  National  Research  Development  Cbrporation  and  from  the  Ministry’s 
OM  research  and  development  establishmenu.  Bach  leaflet  gives  details  of  where  and  how  further  information 
can  be  obtained. 

Ttchllnka  are  designed  as  a  personal  service  restricted  to  those  ia  British  industry  who  are  concerned  wiOi 
research,  design  and  development  and  who  can  directly  exploit  Ue  information  presented.  The  subjects  covered 
are  classified  under  S2  headings  and  customers  receive  only  those  Techlinks  that  are  relevant  to  their  interests. 

The  technical  Inipilry  service  is  based  on  a  oomprehansivc  card  index  to  the  r^wrt  holdings  maintained  at 
the  Centre.  Subject  searches  are  made  on  request  and  bibliographies  in  several  subject  fields  are  published  at 
regular  Intervals. 


3.  LIHITATIBNB  OF  MANUAL  SYSTEM  ANB  KEEP  FtM  MECMANISATIMN 

The  nsnual  system  involved  the  maintenance  of  five  separate  card  catalogues  (Title.  Fereusal  Author. 
Originator.  Qntract  Number  and  DOC  Subject)  The  cards  (now  over  one  alllloa)  were  produced  froa  the  pistes 
used  for  printing  the  h  D  AbatracU"  Journal  and  approximately  thirteen  thousand  were  supplied  foruightly. 
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the  nanual  sorting  and  interfiling  of  new  cards  was  a  foraidable  task  with  no  prospect  of  increase  in 
clerical  staff.  Other  Itnitatlons  of  the  nanual  system  were  a  lack  of  printed  Indexes  to  *11  &  D  Abstracts”,  a 
pressing  need  for  larger  nunbers  of  subject  searches,  inadequate  bibliography  service  and  shortconings  in  the 
stock  control  and  management  statistics. 

It  was  evident  that  nany  of  these  problems  could  be  solved  by  automation  which  would  also  offer  potential 
for  fuller  services.  Accordingly,  a  small  team  was  set  up  in  196S  to  report  on  the  feasibility  of  applying 
automatic  data  processing  within  the  Centre.  Several  reports  have  been  produced  including  TIL  Report  No.l2^ 
describing  the  input  and  output  problems;  Report  No. 16^  and  Report  No. 18’  which  describe  the  main  findings  of 
the  feasibility  team. 

In  1967  it  was  decided  to  go  ahead  with  Phase  I  of  mechanisation  which  involved  the  introduction  of  tape 
typewriters  into  the  report  processing  cycle  and  the  processing  of  the  punched  paper  tape  at  a  computer  bureau 
for  the  production  of  printed  Indexes.  During  the  period  of  Phase  1  financial  approval  was  being  obtained  for 
Installation  of  an  in-house  comprehensive  computer  system,  the  main  services  of  which  are  shown  in  Figure  3. 


4.  IIPIOVED  PROCEDURES  (PHASE  1) 

The  first  stage  of  Phase  1  was  to  obtain  tape  typewriters  for  typing  the  main  bibliographical  data.  Ihe 
individual  (first  generation)  tapes  produced  would  be  then  edited  and  re-nui  through  the  tape  typewriter  to 
produce  offset  lltho  plates  for  printing  the  *71  &  D  Abstracts”  bulletin.  The  system  adopted  separated  the 
various  data  fields  in  each  bibliographical  record  by  an  Item  Separator  Symbol  (ISS)  (an  inverted  delta  V). 
(^currently  a  continuous  second  generation  tape  containing  bibliographical  details  only  would  be  punched  for 
Input  to  the  computer  bureau  which  would  sort  the  data  into  the  order  required  for  printing  the  various  indexes 
to  H  k  D  Abstracts”.  Examples  are  shown  in  para,  (q)  of  Annex  1. 

4.1  Tape  Typewriter  System 

After  a  survey  of  machines  already  in  production,  an  order  was  placed  for  four  Vonamatlc  tape  typewriters 
from  Business  Data  Products  Ltd. ,  and  delivered  during  the  later  part  of  1967.  Figure  4  shows  one  of  the 
machines  in  use.  Operator  training  and  tape  progrem  development  occupied  a  period  of  some  laonths,  but  the 
aystem  became  fully  operational  by  June,  1968. 

The  Vonamatlc  tape  typewriter  utilises  an  IBM  Model  ”C“  standard  electric  typewriter.  The  models  supplied 
to  TIL  each  have  one  punch  and  two  readers  capable  of  reading  either  punched  tape  or  edge-punched  cards.  lSO-7 
eight-channel  code  is  used.  In  the  first  four  machines  functional  and  programming  keys  are  arranged  in  a  panel 
on  the  working  surface  to  the  right  of  the  typewriter  and  these  Include  a  coding  key  which  when  depressed 
allows  fnactlanal  codes  to  be  punched  into  a  tape.  Operating  speeds  are: -  typing:  600  charactere  per  minute; 
reproduction:-  900  characters  per  minute;  tape  skip:-  1,200  characters  per  alnute.  One  reader  is  housed  in  a 
well  St  the  left  of  the  typewriter  and  the  second  reader  la  a  separate  unit  which  can  be  moved  to  any  vonvenlent 
poaltlon  on  the  working  surface.  The  punch  la  at  the  right  hand  side  of  the  control  key  panel.  Override 
ssltdiea  are  fitted  at  the  front  of  the  desk  to  the  right  of  the  typist.  Theae  include  skip  and  atop  overrides, 
and  a  switch  which  will  prevenc  the  ISS  aywbol  from  being  printed,  although  it  still  reproduces  on  a  second 
ganaratlon  tape  which  is  being  punched.  A  fifth  machine  was  subsequmtly  obtained.  This  is  an  improved  model 
using  solid  state  circuits  and  the  reader  sod  punch  are  in  a  separate  unit  to  the  right  of  the  typewriter  desk, 
the  control  keys  are  in  a  row  in  front  of  the  reader  and  punch. 

4. t  Prwhlcms  EkKssmtsred  with  Machiwe  Operatioas 

Initially  teething  troubles  >.;re  experienced  with  the  tape  typewriters.  Intermittent  failures  of  the  punch 
units  were  camssd  by  high  room  atfileat  tamperatures  and  the  close  proximity  of  so  electricity  substation  asking 
the  power  swpply  voltage  always  on  the  high  side.  VoltM*  stabilisers  sere  fitted  and  better  room  temperature 
control  effected  to  give  an  improvsmcnt. 

It  cannot  be  too  strongly  aapbasiacd  that  the  computer  tapes  must  be  accurate.  The  tapes  must  be  free  from 
parity  errors  (is.,  an  odd  number  of  boles  la  one  code),  as  such  an  error  censes  the  tape  reader  of  the  com¬ 
puter  to  reject  lbs  tape.  The  computer  program  counts  both  the  number  of  ISB  symbols  «>d  also  of  line  feeds 
(carriage  retwms)  after  certain  fields  in  each  item.  Tb  ensure  that  theae  are  accurate,  it  is.  therefore, 
secesaary  to  read  each  computer  tape  through  one  of  the  typewriters  and  print  out  the  contMts-  An  occasional 
parity  error  can  b«  corrected  using  a  hand  punch  (if  the  error  is  due  to  a  wisalng  hole  this  is  punched  in  to 
give  the  correct  character;  if  there  is  one  hole  too  msmy  the  character  la  deleted  by  punching  all  channels), 
bat  if  this  eamses  deletion  of  am  ISO  symbol  the  abo'e  item  must  be  billed* .  The  *bill  Item"  code  (Channels 
3:3:4;R)  IS  pamchsd  hy  hand  la  the  tape  feed  about  one  Inch  before  the  first  asasre  bracket  of  the  item  in 
paamtlom.  The  eonputer  will  than  Ipnore  this  Itsm  which  can  be  fed  in  at  the  and  of  the  next  tape  to  be 
pamchsd.  It  was  bopad  that  after  the  first  few  batches  of  computer  tape  these  checking  runs  CLUId  be  dis- 
psssed  wlU.  bat  this  has  sot  proved  possible.  Rssdlag  a  90-lten  tape  takes  from  SO-40  minutes,  so  Uat  if  the 
tape  has  to  be  repumched  sad  re-read,  the  abole  operaiom  cam  take  up  to  three  boars. 

4.3  hepert  Flue 


The  docamaat  flow  processes  for  Recording.  Preparation  of  *%  k  D  Abstracts”  and  the  frodnetion  of  Printed 
Indexes  are  aboan  In  Figure  i.  Ike  detailed  steps  la  the  cperatloma  are  givan  fblly  is  Annex  1. 
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During  the  impleaentation  of  the  Inproved  procedures,  it  was  necessary  to  revise  nethods  of  recording  and 
redesign  some  of  the  standard  foms  in  use.  Typical  new  routines  include  the  following; 


(a)  Movement  Card 

To  eliminate  the  step  of  writing  the  mc^eoent  card,  it  was  decided  that  typing  the  movement  card  and  abstract 
would  take  place  in  one  operation.  A  carbon-patched  flimsy-movement  card  combination  was  designed  and  packs 
01  these  card-flimsy  pairs  obtained.  The  size  of  the  carbon  patch  was  such  that  when  the  bibliographical 
details  and  abstract  were  typed  on  the  flimsy  only  the  bibliographical  details  appeared  on  the  movement  card. 

(b)  Process  Sheet 

In  order  to  reduce  clerical  work,  it  was  decided  to  adopt  the  system  of  marking  up  the  title  page  of  a  report 
so  that  as  much  information  as  possible  could  be  taken  by  the  typist  direct  from  the  report.  The  process  sheet 
was  redesigned  to  combine  the  functions  of  the  original  abstract  and  process  sheets. 


(c)  Edge-punched  Originator  Cards 

A  standard  mtry  for  the  many  names  and  locations  of  originators  of  reports  held  by  the  Centre  is  now 
achieved  by  using  edge-punched  cards.  Each  originator  is  allotted  a  six  figure  code  number.  This  number, 
selected  from  the  TIL  List  of  Corporate  Authors  relates  to  a  punched  card  for  that  originator.  A  master  set  of 
cards  suitably  identified  is  held  by  the  tape  typists,  the  six  flgur  code  number  is  not  typed  on  the  carbon 
backed  movement  card  but  is  transferred  in  non-print  form  to  the  first  generation  tape,  nan  the  i:  it  genera¬ 
tion  tape  is  used  to  produce  the  off-set  lltho  plates  for  *11  m  D  Abstracts”  the  six  figure  code  number  is  again 
nul  typed  but  is  transferred  to  the  second  generation  tape. 

The  movement  card,  abstract  and  originators  edge-punched  card  together  with  the  tape  are  placed  in  a  nail 
wallet  as  shown  in  Figure  6  for  subsequent  vetting  by  the  proof  checkers  and  sorting  into  subject  order  hy  the 
bulletin  editor. 

4. 4  Preparation  of  H  A  D  Abstracts” 

*11  A  D  Abstracts"  bulletin  is  offset-lltho  printed  from  ....  .11th  plates  typed  directly  by  the  ti^  type¬ 
writers.  The  detailed  steps  in  the  operations  are  described  in  para,  (p)  of  Annex  1.  This  method  of  direct 
typing  00  to  printing  plates  was  chosen  as  giving  the  best  results  with  the  reprographic  equipment  currently 
available  at  the  Centre. 

4.3  Prodoctlea  of  Printed  Indexes 

(a)  A  contract  was  let  to  International  Computers  Ltd.  (ICL)  she  prepared  the  computer  programs  necessary 
for  the  production  of  author,  corporate  author,  report  number,  conference,  translations  and  title  indexes  in 
quarterly  and  annual  cuaulatlons.  from  the  data  punched  on  the  paper  tape.  These  form  the  sain  clerical  parts 
of  the  indexing  system;  the  provision  of  detailed  subject  indexes  posed  other  problems  lAlch  are  fait  with  in 
<b)  below. 

Arrangements  were  made  with  the  Central  Computer  Bureau  of  H.H.  Stationery  Office,  for  the  provision  of 
computer  time.  Each  fortnight,  paper  tape  containing  the  bibliographical  data  for  an  issue  of  Tt  A  D  Abstracts” 
la  aent  to  the  Bureau  At  the  end  of  each  quarter,  l.e. .  •  issues  of  the  bulletin,  the  Bureau  provides  the 
print-out  for  the  six  indexes.  At  the  end  of  each  year,  data  from  the  first  three  quarters  and  the  final 
quarter  are  cumulated  into  annual  indexes.  The  coa«oter  print-out  is  sent  to  an  agency  for  the  prodnctian  of 

the  bound  printed  indexes.  This  involves  a  Sdt  reduction  of  a  doubl*  page  of  print-out  on  to  a  foolscap  plate, 

printing,  collating  and  blading.  The  early  trial  runs,  although  usable  were  very  disappointing  in  their  legi¬ 
bility.  The  ordering  of  entries  was  quite  satisfa-'  'ory  and  the  poor  legibility  steamed  from  a  combination  of 
factors; - 

(i)  The  type  fount  on  the  printer  used  at  the  Bureau  was  not  ideal  for  the  degree  of  veduction  required 
for  printing. 

(it)  The  printer  was  run  at  its  feat  speed  of  i .  300  lines  per  minute  which  resulted  in  letters  Juving  out 
of  aligMsmt  and  other  irregularities. 

(ill)  The  print  ribbon  slipped  resslting  in  the  loss  of  the  initial  letters  of  lines. 

(iv)  The  typeface  was  not  alaays  clean  cauaing  letters  such  as  B.  B.  E  to  become  filled  in. 

Attempts  to  offset  the  poor  quality  of  the  print-oat  by  taking  extra  care  in  production  of  printing  plntew 
resulted  in  a  slowing  down  of  the  printing  operation. 

Is  a  subsequent  run  ahlch  tested  the  anmual  cumulation  program  on  data  for  a  half-year,  steps  were  taham  to 
iaprove  the  quality  of  the  print-out.  In  particjlar.  the  printer  was  nm  at  the  slower  speed  of  900  lines 
per  minute,  and  ea  far  as  possible  the  run  was  made  immediately  after  the  computer  printer  bed  been  serviced. 


A  much  better  print-out  reaalted  ahlch  gave  very  eatisfactory  indtxevv 
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(b)  A  specification  for  a  printed  subject  index  based  on  descriptors  has  been  drafted  and  a  progrtuiing 
contract  placed  with  ICL. 

The  first  requirement  in  developing  this  index  was  an  authoritative  thesaurus  of  descriptors.  The  proposed 
LEX  Thesaurus  seemed  to  offer  this  and  with  the  advantage  that  much  of  TIL’ s  input  from  the  USA  would  even¬ 
tually  be  indexed  with  LEX  terms.  ' 

The  LEX  Thesaurus  was  received  in  December  1968  and  descriptor  allocation  commenced 

The  subject  index  will  contain  subject  headings  formed  from  single  descriptors  or  up  to  three  descriptors 
in  combination.  Skilful  editing  is  required  to  give  consistent  headings. 

In  the  computer  input,  the  start  of  an  index  heading  in  the  list  of  descriptors  is  indicated  by  an  asterisk 
and  the  end  of  a  beading  by  an  oblique  stroke.  If  two  or  three  descriptors  are  used  in  the  heading,  they  are 
separated  by  commas.  For  information  retrieval  as  distinct  from  subject  index  compilation,  commas  and  obliques 
can  be  given  equal  value  as  descriptor  separators. 

In  this  example  of  input  the  underlined  descriptors  are  the  index  headings  which  will  be  listed  with  up  to 
82  characters  of  report  title,  the  TIL  Accession  number  and  ‘H  &  D  Abstracts”  location  number  in  the  final 
subject  index. 

/•  Ocean  waves,  mathematical  models  /•  Shallow  water.  Hydrodynamics/  Two-dimensional  flow/ 

Beaches/  Deformation/  Numerical  methods  and  procedures/  Programming  (Computers)/  Mapping  V. 

4.6  Techllnk  Service  -  Use  of  High  Speed  Addressing  Machine 

Although  not  strictly  part  of  the  Phase  i  plan,  an  Elliott  Uymatlc  7000  high  speed  addressing  machine  has 
been  installed  to  cope  with  distribution  to  the  4500  Techllnk  recipients. 

Addresses  are  printed  from  small  stencil  type  address  cards.  Outside  the  typing  area  of  the  card  is  space 
for  punching  up  to  60  holes  to  provide  coded  information  for  selection  of  addresses. 

For  Techllnk  operation  the  holes  are  used  as  a  series  from  1  to  60  and  each  hole  represents  a  specific  subject 
code  desired  by  the  addressee.  The  holes  can  be  programmed  to  convey  other  information. 

The  machine  can  address  postcards,  envelopes  or  print  lists  on  roll  paper  at  a  speed  of  7000  addresses  per  hour. 


5.  TRANSITION  TO  COMPUTER  OPERATIONS  (Phase  2) 

Having  now  gained  experience  in  the  Phase  1  stage  of  mechanisation  work  has  been  proceeding  on  the  prepara¬ 
tion  of  an  operational  requirement  for  the  computer  and  the  necessary  case  writing  to  obtain  financial  support 
for  the  project  to  proceed. 

5. 1  Operational  Requirement 

A  typical  computer  configuration  to  carry  out  the  Centre’ s  operations  would  consist  of  a  central  processor 
having  a  64K  character  core  store  with  two  tape  decks  and  two,  or  possibly  three,  exchangeable  disk  stores, 
depending  upon  the  way  in  which  the  files  of  data  are  to  be  held  and  manipulated.  A  punched  paper  tape  reader 
will  be  required  and  also,  probably,  a  card  punch,  and  output  will  be  via  a  fast  line  printer  capable  of 
printing  in  upper  and  lower  case  and  offering  about  120  print  positions.  The  possibility  of  carrying  out  the 
main  printing  operations  in  an  off-line  mode  is  being  investigated  and  means  are  being  sought  for  providing 
output  suitable  for  driving  computer- control led  photo  type-setting  equipment  at  some  future  date. 

The  main  elements  of  the  input  program  are  shown  in  the  Operational  Requirement,  (Annex  2)  and  programs  for 
Betting  up  files,  sorting  and  printing  data,  retrieving  information  and  carrying  out  control  operations  will 
be  specified  when  the  choice  of  equipment  has  been  made.  The  extent  '  which  Tirogram  packages”  can  be  made 
available  by  manufacturers  will  inevitably  influence  this  choice. 

5.2  Planning  Networks 

Jeflning  the  operational  requirement  is  an  important  stage  but  equally  important  is  the  way  in  which  the 
computer,  when  ordered,  is  integrated  into  the  organisation. 

It  is  necessary  to  define  the  problem  and  to  plan  the  whole  project  so  that  each  task  involved  in  implemen¬ 
ting  the  project  is  performed  at  the  correct  time  and  in  a  prescribed  manner. 

There  are  several  key  stages  involved  in  the  drawing  up  of  plans  and  these  include; 

(1)  Group  the  individual  tasks  under  functions  and  areas  of  responsibility  to  give  a  better  understanding 
of  the  work  and  define  a  network  of  the  plan. 

(ii)  Agree  on  the  staff  resources  necessary  and  estimate  the  duration  of  each  activity  and  calculate  the 
critical  path. 
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(ill)  Define  the  Job  speclflotlon  and  reqwnBlbllitleft  for  ekcb  staff  aeaber  required  to  Inplecent  the  plan. 
Set  up  reporting  control  and  progressing  procedures. 

(It)  Prepare  plans  and  charts  to  utilise  staff,  establish  separate  charts  to  progress  each  function  and 
relate  these  to  the  ahole  project. 

Ibe  Pert  Chart  (Jan.  1969)  for  the  earlj  procureaent  stages  and  the  recrultnent  and  training  of  staff 
for  the  TIL  Coapater  is  sboea  in  Figure  7. 

3.3  Looking  Ahead 

The  pilot  stage  of  aechanlsatlon  at  the  TIL  Reports  Centre  is  now  nerging  Into  the  computer  procureaent 
stage.  Discussions  are  currently  taking  place  aith  coaputer  aanufacturers.  four  of  ahoa  have  made  prellalnary 
subaissions.  These  discussions  are  designed  to  relate  recent  developaents  in  Inforaatlon  retrieval  techniques 
to  the  Centre's  needs  and  the  final  specification  alll  be  dran  up  baring  regard  to  the  extent  to  which  proved 
hardware  and  ready  aade  prograas  can  be  Incorporated. 

An  Illustration  of  the  Centre’s  current  overall  processes  and  services  is  given  in  Figure  8,  the  extra 
services  to  be  provided  ahen  the  on-site  coaputer  is  fully  operational  are  Indicated  in  the  ‘close  lined'  areas. 

As  a  further  longer  tern  developaent  the  Centre's  coq)uter  could  be  used  as  Hlntech's  focal  point  for  inter¬ 
connection  with  other  Inforaatlon  Centres  on  the  lines  shown  In  Figure  9. 
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ANNEX  1 

DETAILED  PROCEDURE  FOR  TAPE  TYPEWRITER  SYSTEM 


The  oaln  steps  in  prooedure  now  in  operation  are; 

(a)  After  duplloate  check,  a  new  report  is  given  an  accession  nuaber.  The  nuaber  is  stamped  on  a  movement 
card.  A  temporary  S  in.  x  3  In.  card  for  the  Originator  card  catalogue  is  written. 

(b)  The  report  title  page  is  annotated  according  to  the  process  sheet  layout.  Items  to  be  recorded  are 
ringed  and  numbered  according  to  the  numbered  fields  in  the  process  sheet.  The  relevant  boxes  in  the 
movement  card  are  ticked  when  the  typist  has  an  entry  to  record. 

(c)  Edge-punched  originator  card  is  selected. 

(d)  Carbon-backed  flimsy  +  movement  card  +  originator  card  are  placed  inside  a  wallet  and  together  with  the 
process  sheet  are  placed  inside  the  report. 

(e)  Report  passed  to  subject  analyst. 

(f)  Analyst  either  ’uinotates  an  author  abstract  in  the  report  or  writes  an  original  abstract  on  the  process 
sheet. 

(g)  Analyst  allocates  UDC  numbers  and  Descriptors  using  the  LEX  Thesaurus  and  writes  them  on  the  process 
sheet. 
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(h)  Abstractor  writes  bis  reconended  distribution  on  the  novenent  card. 

(i)  Report  process  sheet  -t-  wallet  conbal'''.ng  the  cards  is  passed  to  the  tape  typist. 

(J)  The  typist  has  the  tape  prograu  pemanently  in  Reader  1  of  her  nachine.  aie  removes  the  flimsy  and 
movement  card  from  the  wallet  and  places  it  in  the  typewriter.  She  places  the  edge-punched  originator 
card  in  Reader  2. 

(k)  The  typist  carries  out  a  prescribed  series  of  operations;  typing  the  items  of  bibliographical  informa¬ 
tion  from  the  title  page  of  the  report  and  calllug  in  the  tape  program  by  pressing  the  “Start  Read" 
button  of  the  machine  after  completing  each  item  of  data. 

(l)  After  the  abstract  is  completed  and  the  tape  program  tun  to  the  end,  a  short  length  of  tape  feed  is 

punched,  the  tape  torn  off,  folded  and  inserted  in  the  wallet  together  with  the  flimsy  +  movement  card  and  the 
originator  card.  The  wallet  and  process  sheet  are  returned  to  the  report  which  is  passed  to  the  checkers. 

(a)  The  checkers  nark  small  corrections  on  the  flimsy.  For  malor  errors,  the  report  is  returned  to  the 

typist  to  punch  a  new  tape. 

(n)  The  checked  abstracts  plus  reports  are  passed  to  Editor,  “R  ft  D  Abstracts"  where  the  flimsies  are 

detached  and  the  movement  cards  returned  with  the  reports  to  the  Distribution  Section.  The  flimsies  are 
kept  in  the  wallets  with  their  respective  tapes. 

(0)  Editor.  “R  ft  D  Abstracts"  edits  abstracts,  verifies  UDC  numbers  and  descriptors  and  allocates  appropriate 

OOSATI  field  and  group  number.  Abstracts  are  sorted  into  field  and  group  order  and  numbered  serially 

with  an  item  number. 

(p)  The  wallets  containing  the  flimsies  plus  tapes  in  their  serial  order  are  passed  back  to  a  ti^je  typist. 

The  first  tape  is  pi.  ed  in  the  reader  and  an  offset  litho  plate  placed  in  the  machine.  The  first  .subject 
heading  is  typed  from  the  keyboard  with  the  punch  switched  off.  The  first  abstract  is  then  run  through 
the  reader,  the  punch  automatically  being  switched  on  by  a  code  at  the  start  of  the  tape  inserted 
originally  from  the  tape  program.  A  code  punched  in  the  tape  from  the  program  automatically  stops  the 
tape  after  the  first  square  bracket  so  that  the  item  number  can  be  inserted  from  the  keyboard.  At  the 
same  time  as  the  plate  is  typed,  a  second  goieratlon  tape  is  punched  but  a  code  in  the  report  tape  inserted 
by  the  tape  program  automatically  switches  the  punch  off  before  the  abstract  so  that  only  the  biblio¬ 
graphical  details  appear  on  the  computer  tape.  The  punch  is  automatically  switched  on  at  the  end  of  the 
abstract  and  the  machine  stops  so  that  the  typist  can  press  the  Tape  Feed  button  to  give  a  short  length 
of  blank  tape  before  the  next  item.  The  next  abstract  tape  is  then  Inserted  in  the  reader  and  the  process 
repeated.  Further  subject  headings  are  typed  on  the  plates  (but  not  on  the  second  generation  tape)  as 
required.  Each  second  generation  computer  tape  normally  contains  fifty  items,  an  arbitrary  number  chosen 
for  convenience  in  handling.  At  the  end  of  each  tape  the  typist  types  TC4.  a  signal  to  the  computer  that 
the  end  of  the  twe  has  been  reached.  Errors  in  the  original  report  tapes  Indicated  by  the  checkers  and 
editors  can  be  corrected  during  typing  the  plates  by  switching  the  reader  into  single  step  before  the 
error,  typing  the  correct  characters  manually  and  moving  the  tape  the  correct  number  of  codes  past  the 
error. 

(q)  Examples  of  Tape  Typewriter  Output 
(1)  First  Typing 

[]  ERDE-13-R-68  V  V  V  UNLIMITED 

V  Explosives  Res. +Dev.E8t. ,  Ministry  of  Technology.  UK 

,  V  COMPATIBILITY  OF  WHISKERS  OF  SILICON  NITRIDE,  SILICON  CARBIDE  AND  ALUMINA  WITH  METALLIC 
MATRICES  AT  HI(3I  TEMPERATURES 

V 

V 

V  Cannell,  J.C.  8.1968  50pp  ISref 

7  V  V  WAC- 189-011 

V  V 

V 

V  UDC.  669.018.  95/661.665. 1/661.862.  22/546.284’ 171 

V  This  report  describes  the  continuation  of  a  series  of  high  temperature  compatibility  trials, 
screening  various  combinations  of  whiskers  and  metals  for  prolonged  service  at  1100  °C,  as 

a  preliminary  to  possible  development  of  composite  turbine  blades.  The  trials  showed  that 
only  one  sample  of  alumina  whiskers  remained  stable  even  in  pure  nickel.  GMH 


(2)  The  tape  from  (1)  is  run  through  the  machine  cutting  offset  litho  plate  and  producing  2nd 
generation  tape 

The  following  is  the  Rt-D  Abstracts  entry: 

[l001-690l]  ERDE-13-R-68  UNLIMITED 

Explosives  Res.+Dev.Est. ,  Ministry  of  Technology,  UK 
COMPATIBILITY  OF  WHI6KER6  OF  SILICON  NITRIDE,  SILICON  CARBIDE  AND  ALUMINA  WITH  METALLIC 
MATRICES  AT  HIGH  TEMPERATURES 

Cannell,  J.C.  8.1968  SOpp  ISref 

WAC- 189-011 
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UDC.  669.018.95/661.665.  1/661.862.  22/546.  284’  171 

Tills  report  describes  the  continuation  of  a  series  of  high  temperature  compatibility  trials, 
screening  various  combinations  of  whiskers  and  metals  for  prolonged  service  at  1100°C,  as  a 
preliminary  to  possible  development  of  composite  turbine  blades.  The  trials  showed  that  only 
one  sample  of  alumina  whiskers  remained  stable  even  in  pure  nickel.  GMH 


(3)  Print-out  of  2nd  generation  tape 

[1001-6901]  ERDE-13-R-68  V  V  V  UNLIMITED 

V  445000Explosives  Res.-t-Dev.Est. ,  Ministry  of  Technology,  UK 

V  COMPATIBILITY  OF  WHISKERS  OF  SILICON  NITRIDE,  SILICON  CARBIDE  AND  ALUMINA  WITH  METALLIC 
MATRICES  AT  HIGH  TEMPERATURES 

V 

V 

V  Cannell,  J.C.  V  V  8.1968  V  sopp  I5ref 

V  V  V  WAC- 189-011 

V  V 

r  • 

V 


ANNEX  2 

OPERATIONAL  REQUIREMENTS  FOR  A  COMPUTER  IN  TIL  REPORTS  CENTRE 


1.  The  Task 

It  is  intended  that  the  following  work  will  be  undertaken  by  the  comput.r;- 

(a)  Selective  Dissemination  of  Information.  This  service  will  be  based  upon  the  matching  by  computer  of 
index  terms  defining  a  document’ s  contents  against  similar  index  terms  defining  a  user’ s  field  of 
interest.  A  successful  match  will  result  in  a  print-out  of  bibliographic  Information  and  details  of  the 
user’s  organisation  and  address. 

(b)  Subject  Searches.  Searches  are  carried  out  in  response  to  requests  which  can  be  translated  into 
computer  index  entries. 

(c)  Special  Bibliographies.  It  is  a  necessary  function  of  TIL  to  offer  to  its  customers,  from  time  to  time, 
bibliographies  concerned  with  particular  subjects,  authors,  etc. 

(d)  Printed  Indexes.  Experience  has  been  gained  in  the  production  of  printed  indexes  by  computer  bureau. 
This  operation  makes  use  of  punched  paper  tape  produced  by  TIL  tape  typewriters. 

(e)  The  Printing  of  Abstract  Bulletins.  'R  &  D  Abstracts”  is  currently  being  reproduced  from  offset-lltho 
masters  created  by  the  tape  typewriters,  but  it  is  intended  that  the  computer  print-out  will  be  used  to 
produce  the  lltho  masters.  Print  quantity  and  format  considerations  are  such  that  a  single  case  fount 
is  unacceptable,  so  that  this  task  depends  upon  the  provision  of  facilities  for  printing  in  upper  and 
lower  case. 

;f)  Stock  Control.  New  documents  will  be  subject  to  stock  control  by  computer.  Retrospection  offers 
difficulties,  but  the  processes  of  document  contre’  ""  '  it  the  records  of  existing  reports  for 

which  there  is  a  continuing  demand  may  be  gradually  lu. 

The  above  tasks  will  not  necessarily  be  undertaken  in  the  order  shown. 

2.  Activity 

A  summary  of  the  work  load  is  given  in  Appendix  1  -  File  Contents.  Other  Appendices  covering  Input  and 
Output  Volumes  are  available. 

Since  the  processing  routines  will  depend  upon  the  system  and  equipment  employed,  no  attempt  has  been  made 
to  estimate  the  activity  due  to  Intermediate  processing. 

3.  Capacity 

The  equipment  must  have  the  capacity  to  process  within  a  single  week's  shift  the  average  load  Imposed  by  the 
task  defined  in  Sections  3  &  4  including  at  least  8  hours  for  parts  (a),  (b)  and  (c)  of  Section  3,  and  an 
allowance  of  100%  of  the  Job  time  for  parts  (d),  (e)  and  (f)  to  cover  contingencies. 

The  configuration  should  be  capable  of  considerable  expansion. 
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4.  Equipment 

Computer  equipment  approximating  to  the  following  configuration  is  envisaged: - 

(a)  Central  Processor  having  not  less  than  60K  character  core  store  (or  its  equivalent). 

(b)  A  console  typewriter. 

(c)  Punched  paper  tape  reader  capable  of  reading  IS07  code. 

(d)  Punched  paper  tape  punch. 

(e)  Line  printer:  -  at  least  120  print  positions;  upper  and  lower  case  character  set'wlth  special  symbols. 

(f)  Magnetic  tape  and/or  direct  access  magnetic  storage  capable  of  handling  the  input  and  output  volumes 
indicated  in  Appendix  1  assembled  into  appropriate  files.  Ihls  equipment  should  include  at  least  two 
tape  decks  capable  of  reading  and  writing  7-track  magnetic  tape  nt  a  packing  density  of  200  rows  per 
inch,  in  accordance  with  BSS  3958/1966:  capability  of  reading  and  writing  at  556  rows  per  inch  is  also 
desirable. 

(g)  Voltage  regulation  may  be  required. 

The  tape  typewriters  used  to  prepare  computer  input  produce  tape  in  the  ISO  7  code  having  even  parity  in  the 
eighth  channel. 

The  Department  will  consider  the  possibility  of  obtaining  printing  facilities  separately  from  the  main 
computer  configuration. 

5.  Eguipnent  Trials 

Acceptance  of  the  equipment  will  be  subject  to  the  satisfactory  completion  of  equipment  trials  conducted  by 
the  Technical  Support  Unit  of  the  Ministry  of  Technology  on  behalf  of  H.M.  Treasury  and  H.M.S.O. 

6i  Demonstration 

As  part  of  the  process  of  evaluation  the  equipment  manufacturers  may  be  asked  to  demonstrate  selected  tasks 
on  the  proposed  equipment. 

7.  Software  and  Systems  Support 

Manufacturers  will  be  asked  to  provide  details  of  the  systems  and  software  support  which  will  be  made 
available. 

8.  Program  Testing 

Manufacturers  must  be  able  to  offer  ;racllities  tor  testing  programs  prior  to  the  delivery  of  the  equipment, 
on  a  configuration  similar  to  that  ordered. 

9.  Cost  of  Equipment 

The  computer  and  peripheral  equipment  may  be  purchased  or  hired.  If  purchased  the  price  is  not  expected  to 
exceed  £...,000.  If  it  is  decided  to  obtain  printing  facilities  separate  from  the  main  computer  configuration 
(see  Section  4)  the  cost  of  printing  equipment  will  be  deducted  from  this  sum. 

10.  Delivery 

The  date  by  which  delivery  of  equipment  can  be  offered  by  manufacturers  will  be  an  important  factor  in  the 
evaluation  of  tenders. 

11.  Location  « 

A  computer  is  to  be  installed  in  Block  i.  of  Station  Square  House,  St.  Mary  Cray,  Kent,  in  accommodation 
which  has  been  set  aside  on  the  ground  floor. 
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APPENDIX  1 
FILE  CONTENTS 


Hie  file  structure  must  be  compatible  with  the  equipment  employed.  The  following  structure  would  enable  the 
essential  TIL  operations  to  be  carried  out,  but  It  is  realised  that  alternative  file  structures  could  be 
effective. 

1.  Processing  of  Main  Bibliographic  Infnrnation  (MBI) 

Each  document  processed  could  constitute  a  record  In  a  file  held  for  this  purpose.  A  maximum  of  3.  '''>0 
characters  should  be  allowed  for  each  record,  the  average  being  about  1,600  characters.  The  following  data  will 
be  covered: - 


Accession  Number . 

Originator' s  Number . 

Other  Reference  Numbers  (up  to  3) . 

Originator’ s  Identity  (including  country  of  origin) 

Personal  Author  or  Authors  (up  to  S) . 

Foreign  Title . 

Title  (Ehglish) . 

Conference  Paper . 

Date  of  Report . . . 

Security  and  Availability  Classification . 

Contract  Number  and  Period . 

Project  Number . 

Pagination . 

Abstract  Location  Reference . 

Descriptors . 

Abstract  (see  Note  1) . 


Allowing  20,000  items  per  year  for  five  years,  the  total  current  file  length  would  be  100,000  items,  l.e.  a 
maximum  of  300,000,000  characters  approximately. 

2.  Stock  Control  (See  Note  2) 

Each  record  in  the  Stock  Control  File  could  be  held  in  two  parts  as  shown.  The  first  part  would  identify 
the  document  and  the  second  part  would  provide  space  for  op  to  40  transactions  per  document.  The  following 
data  will  be  required: - 

Dociment  Identification 

Accession  Numb  r . 

Quantity  of  copies  held 

Date  of  receipt . 

Pagination . 


Transac  tion 

Copy  Number . 

(or  Quantity  of  Copies  in  Transaction) 

Customer  Identity . 

Loan  Data . 

Date  of  Transaction  . 

Subsequent  Action  Data  (loan  data  and  date) 


Allowing  20,000  items  per  year  for  five  years,  the  total  file  length  would  be  100,000  items,  l.e.  a  maximum 
of  5,000,000  characters  of  Identlficatloo  data  and,  say,  an  average  of  30  x  2,500,000  characters  of  transactions. 
This  represents  a  total  of  80,000,000  charactc-s  approximately. 
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3.  Subject  Searches 

Subject  searches  (Information  retrieval)  will  be  based  upon  the  use  of  descriptors,  so  that  a  compact  fils, 
r  'latins  descriptors  to  document  reference  numbers  only,  will  be  required  for  search  purposes. 

If  the  file  is  held  in  “Inverted”  form,  then,  allowing  for  a  thesaurus  of  18,000  descriptors  having  an 
average  of  80  document  reference  numbers  allocated  to  each  in  five  years,  the  file  will  contain  at  least 
5,000,000  characters. 

4.  Printing  of  “R  &  D  Abstracts  "  arui  Indexes 

The  data  required  for  the  compilation  of  “R  &  D  Abstracts"  could  be  accumulated  continuously  and  held  in  a 
separate  file  for  such  time  as  will  be  required  for  the  printing  and  issue  of  the  bulletin  and  its  indexes. 

The  data  required  for  the  compilation  of  the  Indexes  to  “S  &  D  Abstracts”  could  also  be  held  separately  for 
the  convenience  of  printing. 

There  will  be  four  quarterly  cumulations  snd  an  annual  cumulation  of  the  Indexes  so  that  the  file  will  require 
regular  updating  throughout  the  year.  A  fresh  start  will  be  msde  after  the  issue  of  the  annual  cumulation. 

5.  Selective  Dissemination  of  Information  (SDl) 

Capacity  will  be  required  for  storing  customers*  profiles  (ree  Note  3)  in  the  form  of  lists  of  descriptors. 

TIL  serves  some  7,000  customers,  but  it  is  expected  that  about  800  different  profiles  would  be  registered  when 
the  service  is  fully  developed. 


Descriptors  per  profile 
No.  of  profiles . 


Max. 

Ave. 

300  Ch 
800 

200  Ch 
800 

240,000  Ch 

160,000  Ch 

Thus  an  Initial  space  allocation  of  200,000  Ch  should  suffice,  with  possible  expansion  to,  say,  2.000,000  Ch 
as  the  system  develops. 


Notes 

1.  The  abstract  is  not  always  required  as  part  of  the  sain  bibliographic  information.  It  may,  therefore,  be 
desirable  to  bold  abstracts  on  a  separate  file  with  suitable  cross  references. 

2.  Stock  Control  transactions  generally  fall  into  two  broad  classes,  i.e.  current  and  completed.  The  stock 
control  file  could  thus  be  held  in  two  parts  accordingly. 


3.  A  Tjroflle”  is  a  definition  of  the  field  of  interest  of  a  customer  in  the  form  of  a  list  of  index  terms 
(descriptors). 
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CONNEXION  TO  FLAT  STRIP  CABLE 


This  is  a  quick  and  simple  method  of  making  satisfactory  connexions  to  the 
individual  cores  of  multi-core  flat  strip  cable.  The  connector  combines  the 
cores  and  insulation  into  a  mechanically  and  electricsilly  reliable  unit  on  which 
control  boxes  and  service  outlets  can  be  mounted. 

The  unit  has  a  base  on  which  the  cable  is  located  and  tensioned  by  clamping 
strips.  Over  this  is  placed  a  connector  plate  having  a  series  of  toothed  metal 
strips  (the  number  depending  on  the  circuits  involved)  and  two  transverse  semi- 
cylindrical  projecting  bars  corresponding  to  recesses  in  the  base.  As  the 
connector  plate  is  tightened  down,  the  projecting  teeth  perforate  the  insulation 
of  the  cable  and  form  wiping  butt  joints  with  the  conductors  as  they  are  drawn 
inwards  by  the  entry  of  the  projecting  bars  into  the  mating  grooves.  The 
connexions  so  made  are  brought  out  to  'potted'  multi-way  terminals. 

Since  the  heat  dissipation  of  flat  strip  cable  is  superior  to  that  of  other  types, 
voltages  and  loadings  can  be  increased  without  disproportionate  increases  in 
size  and  weight.  This  method  could  therefore  be  incorporated  in  the  modules 
of  industrialized  building  systems  to  carry  lighting,  telephone  and  other  circuits 
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SUMMARY 


The  parsr  briefly  outlines  the  early  history  and  development  of  the  ESRO/ELDO  Space 
Documentation  Service.  The  Installation  of  the  new  direct  access  remote  console  system 
(NASA/RECON)  Is  described.  The  necessity,  and  difficulty  of  talking  to  the  multilingual 
European  user  is  emphasised.  Cost  considerations  are  mentioned  together  with  the  user’ s 
requirements  in  this  respect.  The  current  feasibility  and  design  study  for  the  creation 
of  a  databank  on  electronic  components  and  materials  is  outlined.  The  possibility  of 
inter-disciplinary  international  direct  access  computer  systems  is  suggested. 


SOMMAIRE 


Cet  exposd  retrace  k  grande  traits  les  ddbuts  et  1’  Evolution  du  Service  de  Documenta¬ 
tion  Spatlale  de  1’ ESRO/ELDO.  L’ auteur  ddcrit  1’ installation  du  nouveau  systfeme  A  accAs 
direct  et  pupftre  commandd  A  distance  (NASA/RECON).  II  souligne  la  ndcessitd  de  parler  A 
I’utlllsateur  europden  multlllngue,  et  les  dlfflcultds  impliqudes.  II  mentionne  certaines 
conslddratlons  de  codt,  alnsi  que  les  conditions  requises  par  1’ utilisateur  dans  ce  domalne. 
II  expose  brlAvement  I’dtude  de  conception  et  de  practlcabilltd  actuellement  effectude  et 
portant  eur  la  crdation  d’une  banque  d’ informations  sur  les  composants  et  matdriels  dlec- 
troniques.  II  suggAre  enfin  la  poesibilltd  de  systAmes  d’ ordinateurs  inter-disciplinalres 
A  accAs  direct. 


THE  USER  AND  THE  AUTOMATED  SYSTEM 
IN  A  EUROPEAN  ENVIRONMENT 

N.E.C.IsottB 


INTRODUCTION 

Ihe  European  l^ace  Research  Organisation  was  established  by  the  Convention  of  14  June  1962,  and  cane  into 
force  on  20  March  1964.  The  ESRO/ELDO  ^ace  Docunentation  Service  was  nut  innediately  set  up;  it  was  first 
established  in  November  1965  so  that  the  development  period  has  been  somewhat  shorter.  During  1968  ESRO 
launched  three  satellites  and  thus  achieved  for  the  first  time,  full  operational  status.  Although  modest  by 
comparison  with  the  NASA  achievements,  they  represent  the  most  complex  satellites  ever  designed  and  built  in 
Europe,  or  operated  from  Europe.  Not  surprisingly,  due  to  its  later  initiation  it  is  expected  that  the  Space 
Documentation  Service  will  only  he  providing  all  the  services  envisaged  from  1970 

In  a  “Study  of  mechanization  in  DOD  libraries  and  information  centres’’  (Ref. 1)  as  long  ago  as  September  1966 
the  following  conclusion  was  drawn:  “the  survey  data  clearly  indicate  some  cases  in  idiich  a  program  of  mech¬ 
anization  was  initiated  and  pursued  simply  because  it  was  the  ‘thing  to  do’ .  Several  of  the  systems  seemed 
remarkably  able  to  operate  and  to  expand  in  the  vacuum  of  a  nearly  complete  absence  of  considerations  of  user 
needs.  ’’  It  seems  however,  that  in  many  of  these  cases  iriiat  really  happened  was  that  machine  time  and  pro¬ 
gramming  effort  were  probably  available  free  of  charge  and  that  therefore  the  ’thing  to  do’,  which  was  in  any 
case  interesting,  became  feasible,  and  even  desirable  in  order  to  help  Justify  equipment  installed  for  other 
purposes,  in  the  case  of  ESRO  however,  an  existing  computer  facility  was  extensively  upgraded  in  order  to 
provide  the  additional  power  and  flexibility  which  vpeared  to  be  necessary  purely  for  documentation  purposes. 
In  this  respect  the  ten  ESRO  member  states  as  represented  by  the  delegates  to  the  controlling  committees,  were 
sufficiently  far-sighted  to  see  the  real  need  for  a  system  versatile  enough  to  satisfy  the  varied  information 
needs,  on  a  centralised  basis,  of  all  the  member  states. 


TO  DESIGN  OR  NOT  TO  DESIGN 

Before  the  establishment  of  SOS  in  November  1965,  prolonged  negotiations  with  NASA  had  taken  place  in  order 
to  arrange  an  exchange  agreement  between  NASA  and  ESRO/ELDO.  It  was  more  than  clear  in  the  early  history  of 
the  Organisation,  that  in  the  first  place  it  would  be  impossible  to  build  up  quickly  a  useful  reference  file 
in  the  space  field,  apart  from  questions  of  cost,  and  that  secondly  the  design  of  a  new  information  retrieval 
system  would  take  too  long  and  would  also  cost  too  much.  In  the  circumstances  the  most  obvious  and  most 
logical  arrangement  was  to  make  use  of  existing  NASA  facilities.  As  a  result  NASA  generously  entered  into  the 
information  exchange  agreement  which  in  a  strengthened  and  proved  form  still  exists  today.  Ubder  this  agreement 
NASA  provided  the  magnetic  tape  files  of  references  to  unclassified  documents  in  the  aerospace  field  (some 
400,000  documents).  In  addition,  master  microfiche  copies  of  the  reports  themselves  together  with  the  necessary 
computer  programs  to  enable  the  files  to  be  machine  searched,  were  provided.  In  return  ESRO,  as  far  as  possible, 
acts  as  a  local  point  for  European  aerospace  reports.  These  are  sent  to  NASA  completely  processed  for  direct 
input  to  the  machine  system. 

The  system  developed  by  NASA  was  Integrated  into  the  European  context  with  only  very  minor  modifications. 

This  was  a  linear  file  search  system  which  operated  as  effectively  as  necessary  on  the  then  some  200,000  docu¬ 
ments.  For  a  new-born  organisation  such  as  ESRO  this  system  in  itself,  which  was  operated  in  Paris  under 
external  contract,  was  of  inestimable  value.  It  has  effectively  satisfied  the  Information  needs  of  ESRO/QjDO 
staff  and  institutes  in  member  states  until  July  this  year.  However,  even  prior  to  this  date  it  had  become 
apparent  that  both  the  volume  of  searching  required,  and  the  size  of  the  file  itself  warranted  some  fundamental 
re-deslgn  of  the  concept.  Once  again  it  was  decided  that  ESRO/ELDO  could  not  really  afford  the  full  effort 
necessary  and  we  turned  once  more  towards  NASA.  For  some  time  NASA  had  been  developing  a  large  scale  batch 
processing  system  for  use  on  inverted  files  in  an  IBM  360  system.  This  it  seemed  would  answer  our  requirements. 
However,  an  even  more  powerful  development  in  the  form  of  NASA/RECON  made  its  appearance.  With  the  con¬ 
currence  of  NASA  sufficient  funds  were  made  available  by  ESRO  to  modify  the  existing  NASA/RECON  system,  under 
contract  with  Lockheed,  for  operation  in  the  rather  different  ESRO  environment.  The  situation  now  is  that  the 
RECON  system  has  been  installed  and  is  operational  between  Paris  and  the  ESRO  computer  centre  in  Darmstadt, 
Germany.  Flexibility  of  this  new  system  is  such,  that  it  is  immediately  clear  that  the  decision  not  to  design 
or  develop  something  else  was  correct. 
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TALKING  TO  THE  USER 

Hie  recent  report  by  The  National  Academies  of  Sciences  and  of  Engineering  on  "Scientific  and  Technical 
Communication”  (Ref. 2)  states  that  "the  management  of  all  scientific  and  technical  communication  activities 
must  be  as  responsive  as  possible  to  the  needs,  desires,  and  Innovative  ideas  of  the  scientific  and  technical 
groups  that  they  serve.  These  activities  must  be  sufficiently  flexible  to  adapt  rapidly  to  changes  in  user 
needs  and  communication  techniques. ”  This  is  stated  in  the  report,  to  be  one  of  three  main  principles  to  guide 
the  management  and  planning  of  scientific  and  technical  information  programmes  and  services.  However,  a 
vitally  important  point  emerges  in  this  connection,  with  regard  to  the  difficulty  of  knowing  the  needs  and 
desires  etc. ,  particularly  in  a  multilingual  European  society.  So  long  as  the  service  concerned  remains  a 
purely  passive  one  it  is  unlikely  that  the  user  will  in  general  take  the  trouble  to  communicate  his  requirements 
to  the  organisation  providing  the  service.  A  part  of  the  trouble  of  course,  lies  in  the  fact  that  the  user  is 
normally  not  aware  of  changes  or  improvements  that  could  be  made,  and  consequently  of  the  desirability  of  making 
them.  For  example  50  years  ago  the  majority  of  the  civilised  world  was  able  to  exist  without  a  motorcar,  and 
if  asked  if  they  would  like  one,  most  people  would  probably  not  have  seen  the  utility  of  such  a  device. 

The  first  requirement  therefore  must  be  to  demonstrate  what  can  be  done  and  then  to  adapt  the  system  as  far 
as  possible,  over  a  familiarisation  period,  to  suit  the  requirements  which  emerge  from  the  user,  after  he  has 
been  exposed  to  the  new  technique.  This  therefore  calls  for  an  active  approach,  inasmuch  as  the  providing 
service  must  go  directly  to  the  user.  Here  there  is  a  difficulty,  since  if  a  new,  highly  technical,  development, 
such  as  RECON,  is  available,  it  is  rather  difficult  to  persuade  the  user  that  this  new  tool  is  indeed  as 
powerful  as  it  is.  It  is  conceivable  that  a  touring  demonstration  unit,  which  links  itself  directly  to  the 
computer  centre  by  dial  telephone  lines,  could  be  established,  on  the  lines  of  the  touring  NASA  :  '  'cational 
unit.  In  Europe  of  course,  for  an  organisation  covering  10  Member  States  the  language  problem  becomes  very 
important.  The  ESRO  ^ace  Documentation  Service’s  answer  to  this  situation  was  to  set  up  its  Customer  Liaison 
Unit.  This  is  a  small  team  of  five  individuals,  with  occasionally  the  help  of  additional  supporting  staff. 

Their  almost  superhuman  task  is  to  cater  for  the  disciplines  covered  by  the  NASA  documentation  system,  in  any 
one  of  the  10  Member  State  languages.  I  think  you  will  realize  that  to  do  this  job  properly,  almost  certainly 
a  much  larger  staff  unit  would  be  required.  However,  I  think  you  will  also  agree  that  in  this  nucleus  of  five 
people,  we  have  a  rather  unique  approach  to  the  problem.  It  can  be  regarded  as  a  spearhead  sales  force  with  a 
portfolio  of  services,  which  often  by  the  way  have  to  be  paid  for,  just  as  if  it  was  a  collection  of  detergent 
samples.  Perhaps  in  a  way  the  latter  are  easier  to  sell,  particularly  with  the  addition  of  an  enzyme  or  two. 


THE  IMPORTANCE  OF  COST 

A  wide  divergence  of  opinion  seems  to  exist  on  the  question  of  the  correct  price  for  a  computer  search 
(apart  from  the  question  of  actual  cost).  A  librarian  user  would  invariably  say  the  machine  services  are  too 
expensive  for  my  budget;  a  market  research  consultant  will  say  the  services  are  too  cheap,  and  therefore  they 
will  not  be  appreciated  at  their  true  value.  Someidiere  in  between  lies  the  user,  who  if  he  has  a  real  need 
would  almost  certainly  pay  whatever  is  a  fair  price. 

He  have  found  that  it  is  easier  to  promote  the  use  of  mechanised  services  on  a  paid  basis  fur  retrospective 
searches  of  a  large  file,  where  the  amount  paid  bears  some  relation  to  the  true  cost  of  the  search.  The  user 
himself,  can  usually  see  the  major  advantages  in  being  able  to  coordinate  numbers  of  terms  at  a  time,  whilst 
searching  a  large  collection.  SDI  services  however,  although  extremely  popular,  prove  more  difficult  on  the 
rather  more  expensive  tailor-made  system.  Thus  emulating  NASA,  although  in  this  case  quite  independently,  we 
have  found  it  necessary  to  introduce  what  we  call  a  Standard  Profile  service,  and  NASA  calls  "SCAN”.  The 
Standard  Profiles  are  obtainable  at  roughly  1/5  of  the  price  of  the  tailor-made  product.  They  are  of  course 
not  tailor-made,  but  they  are  produced  on  a  continuing  basis  and  they  clearly  satisfy  a  customer  requirement. 
The  effect  of  the  introduction  of  this  new  service  this  year,  may  be  seen  in  the  attached  graph.  It  is  an 
interesting  fact  that  relevance  levels  need  not  be  too  high  if  the  customer  pays  for  the  service,  unless  he 
pays  per  item.  Host  of  them  consider  that  a  little  Tiolse”  ia  acceptable,  even  a  little  desirable,  since  it 
offers  a  limited  facility,  although  admittedly  a  poor  substitute,  for  browsing. 


THE  USER'S  REQUIREMENTS 

In  general,  when  the  user  is  paying  for  the  services  provided,  the  first  requirement  seems  to  be  speed  of 
response.  In  many  cases  even  lists  of  accession  numbers  are  preferred  if  they  can  be  obtained  quickly. 
Consequently,  the  argument  is  that  with  a  basic  list  of  references,  the  user  can  often  immediately  find  Borne 
of  the  more  important  items  for  himself.  Subsequently,  if  a  comprehensive  bibliographic  listing  follows  the 
initial  list  of  accession  numbers,  the  user  may  make  a  second  solectlon  of  the  items  of  secondary  importance, 
based  on  the  fuller  information  provided. 

The  next  requirement  appears  to  be  full  coverage  of  available  sources.  It  is  fairly  clear  that  many  users 
would  like  to  be  able  to  go  to  one  unique  centre  for  documentation  on  any  subject  need.  I  believe  that  some 
documentation  centres  in  Europe  are  working  towards  this  ideal,  but  there  are  of  course  the  usual  difficulties 
with  regard  to  mixed  machine  ayatems.  The  MARC  system  would  appear  to  bo  one  of  the  first  steps  in  this 
direction,  and  we  are  watching  this  with  considerable  interest. 

The  third  requirement  is  document  availability.  As  nose  of  us  well  know  it  is  very  little  use  whetting  the 
user's  appetite  with  long  lists  of  unavailable  publications.  He  ourselves  are  only  able  to  provide  copies  of 
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certain  NASA  documents  from  the  microfiche  file  deposited  with  ESRO  by  NASA.  In  this  respect  there  is  a 
definite  lack  in  the  completeness  of  the  service  we  offer.  However,  you  are  familiar  with  all  the  difficulties 
connected  with  copyright  and  storage  problems. 

Finally  cheapness  of  service  is  of  importance  for  routine  maintenance  of  users’  information  needs.  Most 
people  will  pay  large  sums  for  urgently  required  material,  if  they  are  sure  that  the  service  is  fast,  and  that 
they  are  getting  as  complete  a  coverage  as  possible.  Wc  have  a  peculiarly  difficult  situation,  in  as  much  as 
we  provide  both  free  and  paid  services  at  the  same  time  to  the  same  users.  Currently  we  are  thinking  of 
changing  our  price  arrangements  so  that  only  retrospective  file  searches  are  provided  free  of  charge.  Such 
searches  would  only  be  made  available  of  course  to  institutes  in  member  states  actively  engaged  in  the  ESRO 
programme. 


NEW  SERVICES 

A  new  service  is  emerging  from  a  requirement  first  stated  by  our  Establishment  in  Holland,  the  European 
Space  Technology  Centre  (ESTEC).  This  is  the  ESRO  Establishment  where  current  satellites  are  designed  and 
tested.  The  problem  here  is  one  of  selecting  from  a  large  number  of  alternatives,  as  is  for  example  necessary 
when  choosing  a  material  or  component  for  a  particular  application.  We  are  therefore  now  in  the  feasibility 
and  design  study  stages  for  a  new  project  which  is  the  creation  of  a  databank  of  information  on  electronic 
components,  with  the  capability  for  extension  to  include  other  data  fields  such  as,  for  example,  materials  for 
use  in  the  space  environment.  Initially  this  will  be  a  databank  of  quality  and  reliability  test  data,  to  be 
used  as  an  aid  in  the  selection  of  hlgh-reliablllty  electronic  components  for  use  in  ESRO  satellites.  In 
addition  however,  we  plan  that  the  databank  should  contain  a  basic  level  of  manufacturers’  catalogue  data,  for 
all  European  electronic  components. 

• 

Access  to  the  data  will  be  possible  by  conventional  batch  processing,  which  will  provide  for  the  generation 
of  selective  dissemination  notices  presenting  detailed  information  on  each  component  selected,  and  for  search, 
queries  to  be  processed  against  the  entire  databank.  In  addition  a  remote  on-line  interactive  interrogation 
system  will  be  implemented  utilising  the  same  peripheral  equipment  as  NASA-RECON.  The  input,  display  and 
printout  of  graphical  data  is  being  examined  and  will  be  incorporated  at  an  early  date.  A  third  mode  of  opera¬ 
tion  is  possible  which  is  expected  to  be  used  extensively  not  only  by  SDS  documentallsts,  but  also  by  scientific 
and  technical  staff  when  copious  output  is  expected.  This  is  intermediate  between  batch-mode  and  on-line  inter¬ 
active  mode  and  is  a  form  of  remote  batch  entry;  profiles  or  search  queries  will  be  defined  using  the  terminal 
and  then  stored  for  later  processing  in  the  batch  stream  on  a  priority  system.  A  generalised  system  flow  diagram 
is  shown. 

Clearly  the  databank  now  envisaged  ciiould  be  potentially  very  valuable  not  only  to  ESRO,  but  also  to  the 
entire  European  electronics  industry.  We  intend  that  it  should  be  fully  exploited  by  making  available  a  variety 
of  services  against  subscription.  Taese  will  include  say,  fortnightly  current  awareness  notifications  of  newly 
introduced  products  in  considerable  .ietall.  Later  we  would  hope  to  produce  quarterly  and  annual  cumulative 
specific  catalogues.  Evidently  also,  c  search  against  the  entire  data  set  would  give  a  state-of-the-market 
survey. 


CONCLUSIONS 

In  a  paper  entitled  ‘Vlanning  and  Development  of  the  European  Space  Documentation  Service:  an  Example  of 
International  Collaboration"  (Ref. 3),  the  author  stated,  “It  is  at  least  in  theory  possible  to  imagine  a  group 
of  countries  deciding  to  create  an  information  system  related  to  several  scientific  and  technological  user- 

areas  .  there  is  a  real  prospect  that  with  large  third-generation  computers  a  system  of  direct  interrogation 

of  the  computer  by  users  will  become  possible.  The  Implications  .  require  urgent  study  .  "  This  paper 

was  written  in  1967  and  the  conclusions  are  even  more  valid  today.  The  NASA  documentation  system  already 
covers  a  large  number  of  disciplines,  and  based  on  it,  we  in  ESRC,  can  provide  a  number  of  services,  including 
direct  access  capabilities.  The  addition  of  databank  features,  also  with  direct  access  possibilities,  increases 
the  scope  of  services  available.  It  is  also  conceivable  that  the  NASA  system  will  be  applicable  to  other 
documentation  files  in  the  near  future. 

All  the  ingredients  are  there  -  is  the  user  yet  educated  enough  to  act  as  the  catalyst  which  produces  the 
ultimate  system? 
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Careful  planning  end  tactful  action  to  ready  the  organization  are  critical  to  the 
success  of  automation.  In  spite  of  the  obviousness  of  this  platitude  many  egregious 
system  failures  have  resulted  from  unrecognized  organizational  resistance.  Ihe  assault  of 
the  system  analysts  and  programmers  is  often  either  naive  or  machiavellian:  naive  when  it 
assumes  that  cctiputer  technology  is  the  wave  of  the  future  and  no  rational  employee  could 
object  to  the  new  system;  machiavellian  when  technolo-^y  is  used  as  a  pretext  to  wrest 
control  of  the  organization' s  Information  network  and,  thus,  control  of  the  organization 
itself.  To  facilitate  an  effective  automation,  ■sanagement  must  recognii^e  these  potentials 
for  conflict;  act  to  resolve  those  which  develop;  develop  and  maintain  a  climate  hospitable 
to  change;  involve  personnel  throughout  the  organization  in  system  design  and  developmenc:; 
recognize  and  act  to  reduce  unrealistic  uncertainties  and  feais;  control  the  enthusiasms  of 
the  technologists;  and  insure  that  employees  are  trained  to  accept  new  ways  and  new  roles. 

"As  the  births  of  living  creatures  at  first  are  ill-shapen,  so  are  all  Iiuiovations.  which 
are  the  birth'  of  time.” 

B&con 


SOHISiAIRE 


Une  planlfication  approfondie  et  des  dispositions  pleines  de  tact  sont  des  atouts 
essentials  au  succ^s  de  l’aut( jitisation  d’une  organisation.  B/  ddpit  de  I’dvidence  de 
cette  remarque,  on  enregistre  des  tehees  nomnreux  et  insigoes  r^su.ltant  d’  une  resistance  non 
reconnue  de  1’ organisation.  Les  me'thodes  d’approche  des  analystes  de  syst^mes  et  des  pro- 
grammeurs  sont  souvent  nalves  ou  machiaveliques;  naives  lorsqu’elles  posent  en  postulat  que 
la  technologie  de  I'ordinatour  est  la  vole  de  I’avenir  et  que  nul  employd  doud  de  raison  ne 
peut  dmettre  d’ objection  A  I'dgard  du  nouveau  systdme;  machiavdliques  quant  la  technologie 
sert  de  prdtexte  pour  obtenlr  par  la  force  le  contrSle  du  rdseau  d’ information  de  1’ organisation, 
et  ainsi  celui  de  1' organisation  elle-oftne.  Pour  faciliter  une  automat i sat  ion  et  la  rendre 
efficace,  la  direction  dolt  reconnaftre  ces  causes  potentielles  de  conflit;  prendre  des 
dispositions  pour  rdsoudre  ceux  qui  cq)paraissent;  erder  et  maintenir  un  climat  favorable  au 
changement;  faire  en  sorte  que  le  personnel  de  toute  1’ organisation  soit  concernd  par  la 
mlse  au  point  et  le  ddveloppement  du  systdme;  reconnaftre  certaines  Incertitudes  ou  craintes 
non  rdalistes,  et  s’ efforcer  de  les  rdduire;  noddrer  1’ enthousiasme  des  technologues  et 
s’ assurer  que  les  employds  regolvent  la  formation  propre  A  leur  faire  accepter  de  nouvelles 
mdthodes  et  de  nouveaux  rfiles. 
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The  preparation  of  this  paper  has  been  a  huabllng  experience.  A  hurried  review  of  fifteen  years  of  conputer 
systeas  developaent  and  adninlstra^-lon  revealed  a  singular  gap  with  regard  to  organized  thought  on  preparing 
the  organization  for  cooputer  systeas.  Upon  further  reflection  at  seeaed  clear  that  the  probica  was  far  froa 
trivial,  and,  in  fact,  the  o^ority  of  known  systee  failures  had  probably  resulted  froa  aan  rather  than  aacblne 
probleas.  I  had  been  certain  that  the  textbooks  and  professional  literature  would  provide  the  fraaework  and 
•strategy  I  had  alssed  in  ay  previous  reading.  I  went  through  ay  two  feet  of  old  Datamation  nagaziues;  I  found 
no  articles  at  all!  Soaewhat  shaken  I  turned  to  the  Computing  Reviews  (Refs.  2' S)  and  searched  1960  to  1967  and 
found  nothing  While  I  aa  not  a  good  searcher  and  there  aay  be  articles  I  alssed,  the  conclusion  still  seemed 
Inescapable  that  the  inforaatlon  technology  professions  in  their  professional  literature  were  unconcerned  about 
actually  getting  organizations  to  adopt  their  systems.  But  the  problem  is  very  real,  and  multiplying  “user 
needs"  studies  bear  mute  testimony  to  one  aspect  of  it. 

As  an  example  of  a  typical  problea,  I  had  occcslon  not  long  ago  in  a  previous  Job  to  observe  the  floundering 
of  a  new  system  developaent  effort,  a  larg^'-scale.  Integrated,  on-line,  information  handling  system  for  an 
organization  which  already  had  a'successful  batch  processing  system.  The  batch  processing  system,  itself,  was 
in  trouble  because  the  organization  had  had  it  built  completely  by  contract  and  had  allowed  the  knowledge  of 
this  system  to  be  concentrated  into  the  hands  of  one  or  two  individuals.  These  individuals  had  finally  left 
the  organization,  and  It  was  wlt.hout  any  knowledgeable  programmers  or  documentation  on  its  operational  systea, 
one  which  had  to  be  run  on  a  regular  24-hour-a-day  basis  to  provide  essential  services  to  users.  Thus,  the 
organization  was  trying  to  siaultaneously  build  a  new  system  and  survive  the  crises  of  the  old. 

The  leading  actors  in  the  developaent  of  the  new  system  were  the  chief  of  the  computer  center  and  the  chief 
of  the  division  which  the  new  systea  was  supposed  to  serve.  Their  relationship  was  star-crossed  from  tse 
beginning,  because  the  conputer  center  had  once  been  controlled  by  the  division  chief  for  tdiom  the  new  system 
was  being  built.  It  had,  however,  recently  been  aoved  into  a  higher  organizational  positlou  so  as  to  be  able 
■to  serve  other  elements  of  the  organization”. 

The  system  to  be  built  was  not  well-defined.  First,  its  goal  was  clearly  to  automate,  for  the  sake  of  auto¬ 
mation,  the  input  process  to  the  old  system.  There  bad  sever  been  sii  analysis  that  indicated  that  such  auto¬ 
mation  was  desirable,  nor  that  it  would  produce  a  more  efficient  or  a  more  economic  operation.  The  faith 
certainly  existed,  however,  ’’hat  it  would  somehow  make  it  possible  to  meet  the  rising  demands  for  services  for 
which  additional  personnel  could  not  be  obtained  It  also  had  the  major  advantage  of  being  non-threatening  to 
the  top  managers  in  the  operating  elements  because  the  new  on-line  system  would  support  their  internal  effort 
rather  than  change  the  nature  of  theU  relationship  to  each  other  or  to  the  users  of  the  services  of  the 
organization.  A  major  software  house  had  the  audacity  to  accept  a  contract  to  build  the  new  on-line  computer 
system  and  was  soon  trapped  in  the  cross  fire  between  the  principals  and  their  staffs. 

Since  the  .system  was  not  well-defined,  the  first  step  was  to  define  clearly  the  functions  and  operations 
that  it  was  to  perform.  The  using  division,  however,  felt  very  threatened  by  the  insistence  that  it  define 
Hr  reauirements  with  precision.  The  specter  that  haunted  it  was  of  having  some  set  of  requirements  finally 
accepted;  having  the  computer  people  go  off  and  build  the  system  to  meet  those  requirements;  and  then  having 
them  come  back  with  a  system  that  met  every  single  one  of  the  precisely -stated  requirements  but  failed  to  help 
accomplish  the  floundering  functions  of  the  operating  manager. 

This  threat,  of  course,  was  not  illusory.  Such  systems  have  been  built,  and  such  results  have  occurred.  In 
this  particular  case,  a  cycle  of  definition  and  re-deflnltion,  using  more  and  more  abusive  language  end  Involving 
more  and  more  abrasive  encounters,  developed  between  the  two  staffs  with  the  contractor  's  the  shuttlecock. 

As  the  situation  worsened,  the  operating  division  manager  finally  forbade  all  his  people  to  talk  to  the 
contractor  or  the  representatives  of  the  computer  division,  and  the  head  of  the  computer  division  refused  to 
meet  with  the  bead  of  the  operating  division.  This  Impasse  had  to  be  resolved  by  higher  authority.  I  am  sure 
you  will  be  glad  to  know  that  the  story  had  a  happy  middle;  the  internal  factions  were  momentarily  resolved; 
the  organization  Joined  forces  against  the  contractor;  and  a  stiff  penalty  wan  imposed  on  him  for  failing  to 
deliver  the  initial  phase  of  the  system  in  time.  It  still  remains  to  complete  the  whole  system;  only  the  first 
round  is  over. 

The  National  Library  of  Medicine  has  had  similar  problems.  It  began  seriously  considering  automation  in  1949 
and  .moved  into  a  punch-cardAilstomatic  eybiem  in  1959.  This  original  system  was  also  born  in  a  time  of  scarcity. 
The  Library  had  had  no  increases  in  authorized  personnel  for  ten  years,  in  spite  of  having  graduated  out  of  the 
Army  to  become  a  national  resource.  A  singularly  candid  account  (Ref. 14)  of  this  development  reads  in  part: 


“Januar?  1960.  A  catastrophe  was  discovered  on  January  S.  For  an  unknown  length  of  tlue  the  camera  had  been 
operating  with  no  exposure  light  flashing.  The  entire  subject  and  author  sections  had  to  be  rerun.  Page 

stripping  was  performed  on  a  crash  basis  by  four  operators _  The  Indexing  Assistant  backlog  rose  to  6,300; 

the  Input  typing  backlog  rose  to  4, 200;  the  proofreading  backlog  rose  to  3. 455;  the  keypunching  backlog  dropped 
almost  3,000  to  584;  the  output  imprinting  backlog  rose  to  3,208.  Input  typewriters  suffered  from  minor  prob¬ 
lems  such  as  blown  fuses.  Keypunching  Improved.  Output  Justowrlte.-s  were  proving  to  be  prone  to  breakdown; 
there  were  el<!ht  days  of  down-time  here.  Adequate  film  processing  in  Washington  was  still  unavailable,  and 
film  was  transported  via  Trailways  Bus  delivery  service  to  be  processed  in  New  York." 

It  seems  evident  that  some  of  the  woes  of  this  system  may  have  resulted  from  resistances  in  the  organization. 
This  system  paved  the  way,  however,  for  the  present  computer  system,  the  Medical  Literature  Analysis  and 
Retrieval  System  (MEDLARS)  (Ref.  1).  Thus,  the  NLM  advanced  by  Increments  to  its  present  system;  an  option  no 
longer  open. 

Were  these  experiences  Isolated  ones?  A  review  cf  literature  found  through  other  sources  appears  to  indicate 
that  they  were  not  isolated  phenomena.  McKinsey  and  Company  ran  a  survey  (Ref. 11)  in  1963  of  some  27  companies 
and  Identified  three  factors  as  being  crucial  to  the  few  successful  computer  systems.  These  were:  executive 
leadership,  management  control,  and  the  Involvement  of  operating  management. 

The  same  company  repeated  the  survey  (Ref.  12)  in  1968  and  concluded  gloomily,  “from  a  profit  standpoint,  our 
findings  indicate,  computer  efforts  in  all  but  a  few  exceptional  companies  are  in  real,  if  often  unacknowledged, 
trouble".  The  major  problem  identified  by  the  survey  was  the  gap  between  the  computer  staff  and  the  operating 
management.  To  bridge  that  gap,  McKinsey  and  Company  proposed:  improved  teamwork  in  the  corporation  between 
the  top  management,  operating  managers,  and  the  computer  professional;  more  extensive  reliance  on  evolutionaiy 
development  of  computer  systems  rather  than  turn-key  operations;  careful  consideration  and  use  of  communications 
with  computers  and  on-line,  remote-access  systems;  and,  most  important  of  all,  improved  leadership  from  the  top 
executives  in  the  company. 

Another  recent  survey  (Ref. 18)  done  independently  by  Putnam  reviewed  tne  success  of  computer  systems  in  some 
20  films  and  found  the  major  sources  of  resistance  to  integrated  information  systems  in  the  large  corporation.' 
to  be;  lazy  senior  management;  insecure  operating  managers  who  are  threatened  by  automation;  organizations 
which  are  themselves  already  sick  and  are  more  concerned  with  being  able  to  affix  blame  for  efforts  than  credit 
for  effective  action;  executives  who  are  “egocentric"  and  sufficiently  powerful  to  override  the  valid  objectives 
of  the  organization;  and  politics  within  the  company.  The  most  difficult  problem  with  regard  to  installing 
unwelcome  systems  was  politics,  because  the  manager  who  is  acting  from  political  interest  can  be  completely 
rational  and  most  effective  in  his  action  to  defeat  the  success  cf  a  new  system.  Such  activity  is  at  its  worst 
in  organizations  which  have  internal  empires  ruled  by  their  own  feudal  lords.  The  suggestions  of  Putnam  to 
solve  these  difficulties  and  dangers  were;  involvement  of  the  senior  company  executive;  obtaining  outside, 
objective  evaluation  Judgment  (from  a  management  consultant,  naturally);  and  a  constant  alertness  to  the  human 
problems  involved  in  the  systems  implementation. 

It  would  certainly  seem  from  this  brief  review  of  available  surveys  that  the  human  problem  in  the  organiza¬ 
tion  deserves  careful  consideration  in  planning  the  installation  of  a  new  system. 

There  has  been  substantial  work  on  innovation  in  industrial  organizations.  The  business  administration  world 
has  been  studying  it  in  their  schools  for  many  years.  There  are  good  texts  on  organizational  behavior  (Ref.  8). 

The  Institute  for  Research  on  Human  Behavior  has  charted  some  of  the  behavioral  science  aspects  of  the  problems 
(Refs. 10  and  17),  and  Mumford  (Ref. 16)  has  summarized  much  of  this  work  in  relation  to  EDP  in  a  very  perceptive 
article.  She  pointed  out  that  the  stability  of  the  organization,  the  user  perception  of  the  change,  the  strategy 
for  change,  and  the  role  perception  of  the  computer  group  are  the  Important  parameters  in  determining  the  success 
or  failure  of  a  system. 

My  own  experience  leads  me  to  believe  that  the  installation  of  new  systems  begins  in  a  paradox,  also  identified 
by  Mrs  Mumford:  a  stable  organization  satisfied  with  its  own  performance  and  piovlJlng  personal  satisfaction 
to  its  employees  cannot  be  automated,  but  automation  as  a  cure  in  an  unstable  organization  is  fated  to  be  born 
in  confusion  and  conflict.  Many  attempts  to  introduce  ADP  into  stable,  well- functioning  organizations  have  met 
with  open  resistance  or  apathy.  As  Michael  (Ref. 15)  observed,  "The  risks  of  Individual,  interpersonal,  and 
organizational  failure  involved  in  deliberately  accepting  the  uncertainty  that  must  eocempany  organizational  and 
individual  changes  are  usually  too  great  for  men  to  take  willingly  when  things  are  going  well  and  when  mei.  and 
institutions  have  been  successful....  The  evidence  Indicates  that  basic  organizational  changes  can  occur  th»-ough 
disasters  or  by  deliberate  organizational  change  programs.  The  latter  must  be  directly  and  continuously 
supported  from  the  top  of  the  organization  over  many  years  of  unremitting  and  highly  organized  effort.  Such 

deliberate  efforts  have  been  rare .  "  Thus,  one  could  nonolude  that  the  efforts  which  have  been  undertaken 

must  have  largely  been  spurred  by  the  threat  of  disaster. 

Now  the  disaster  which  threatens  information  centers  is  overload  of  input  and  insatiable  demand  for  services. 

As  such  overloads  develop,  compensating  actions  are  taken  by  th..-  '  ration.  These  are  described  in  a  study 

of  a  university  library  by  Meter  (lief.  13).  As  loads  Increase  efficiency  eventually  drops,  much  as 

the  throughput  of  a  hignway  drops  with  heavy  traffic.  Stress  and  v  incresse  with  backlogs  and  complaints 

until  collapse  threatens.  (Systems  i!o  collapse,  they  don't  just  fade  awsy.  The  Chicago  mail  system  collapsed 
several  years  ago. ) 
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As  the  specter  of  collspse  begins  to  naterisilize,  the  orgsnlzatlon  nay  tuns  to  thoughts  of  ADP.  The  hope 
being,  of  course,  that  ADP  wiXl  stave  off  disaster.  In  reality  the  installation  of  ADP  systems  requires 
investment  of  scarce  resources  in  design  and  in  parallel  operation  which  further  d^rade  the  performance  of  the 
information  center.  But  ADP  development  offers  hope  of  relief.  If  that  hope  is  kept  within  reasonable  levels 
and  if  the  system  progresses  so  as  to  maintain  hope,  a  success  may  result.  If  expectations  become  excessive 
or  the  system  development  stumbles,  the  organization  will  lose  faith  and  the  aystem  will  fall.  As  Hoffer 
observed  in  The  Ordeal  of  Change  (Ref.  7)  “When  a  population  undergoing  drastic  change  is  without  abundant 
opportunities  for  Individual  action  and  self-advancement,  it  develops  a  hunger  for  faith,  pride,  and  unity. 

It  becomes  receptive  to  all  manner  of  proselytizing,  and  is  eager  to  throw  itself  into  collective  undertakings 
irtjich  aim  at  ‘showing  the  world' .  In  other  words,  drastic  change,  under  certain  conditions,  creates  a  proc¬ 
livity  for  fanatical  attitudes,  united  action,  and  spectacular  manifestations  of  flouting  and  defiance;  it 
creates  an  atmosphere  of  revolution."  If  these  energies  can  be  channeled  toward  the  development  of  a  new 
system  great  progress  is  possible;  if  they  oppose  it  failure  is  sure. 

Thus,  often  the  first  problem  of  tbs  system  developer  is  the  harnessing  of  irrational  forces  to  provide  the 
extraordinary  effort  required.  At  the  same  time,  however,  he  must  move  to  increase  the  rationality  of  the 
organization.  This  rationality  can  be  improved  in  a  variety  of  ways.  The  first  is  to  reduce  the  uncertainties 
and  fears  associated  with  the  new  system  and  move  to  avoid  excessive  expectation.  These  objectives  can  be 
achieved  through  preparation  of  an  implementation  plan  and  the  presentation  of  that  plan  to  affected  members  of 
the  organization.  Such  a  plan  should  justify  the  new  system  and  specify  how  it  will  resolve  the  crises  or 
Inadequacies  of  the  present  system.  It  should  provide  an  overview  of  the  new  system  and  of  how  it  will  help 
the  function  it  is  to  support.  The  plan  should  specify  the  probable  Impact  on  organizational  elements,  managers, 
and  individuals,  and  provide  people  throughout  the  organization  with  information  on  job  changes,  training,  and 
replacement  programs.  It  should  provide  a  schedule  for  the  effort  and  specify  the  costs.  The  schedule  should 
be  clear  on  the  period  of  parallel  operation.  Finally,  it  should  specify  who  or  what  organizational  elements 
are  expected  to  participate  and  what  the  responsibility  of  each  is.  The  press  of  time  and  the  rate  of  change 
of  some  aspects  of  the  above  may  make  it  dl fficult  to  produce  a  formal  plan  but  such  information  should  exist 
and  be  available  to  the  concerned  staff. 

Not  to  provide  such  information  raises  the  conceni  and  resistance  of  personnel  who  may  believe  they  are 
confronted  with  a  machiavellian  manipulation.  Cooperation  and  rationality  must  be  fostered  through  clear 
specification  of  goals  and  the  road  to  these. 

Cooperation  however  will  not  be  enough.  Dev^loyers  of  systems  must  continuously  strive  to  support  their 
development  through  legitimate  power.  As  every  survey  found,  top  management  must  support  the  system.  Main¬ 
taining  this  support  when  the  organization  is  faced  with  day-to-day  operational  problems  iih  not.  easy,  but  without 
such  support  the  human  Investment  for  the  “Great  Leap  Forward"  will  not  be  found  in  time,  momentum  will  flag, 
and  the  movement  will  fail.  It  is  particularly  important  that  the  reward  end  punishment  system  reflect  this 
top  management  support:  Those  who  contribute  to  the  new  system  should  be  rewarded  and  promoted,  rather  than 
dropped  from  the  mainstream  of  advancement  as  is  sometimes  the  case.  Similarly,  effective  deterrents  to 
resistance  need  to  be  developed. 

To  provide  a  vital  Incentive  to  the  development,  it  should  be  a  little  daring.  Doing  Tdiat  many  others  have 
done  before  because  it  looks  safe  may  not  be  safe.  A  trite  system  may  look  easy  to  build;  but  it  will  not 
mobilize  effort  the  way  an  imaginative  one  can.  Pride  in  technological  sophistication  can  be  an  important 
stimulus  to  all  levels  toward  effective  systems  development,  and  it  has  become  a  goal  in  itself  of  some 
corporations  (Ref. 6). 

Harnessing  irrationality  and  creating  the  climate  for  change  must  be  paralleled  by  efforts  to  Involve  all 
levels  of  the  organization  in  the  development.  Managers  must  be  involved  in  establishing  goals,  directing  and 
assisting  in  functional  analyses,  and  explaining  the  system  to  their  staff,  users,  and  outside  groups.  This 
new  system  shoulo  not  become  the  property  of  the  ADP  staff,  but  all  management  must  assume  a  stake  in  the 
success  of  the  effort. 

Of  almost  equal  importance  to  the  managers  are  the  opinion  leaders.  These  must  be  converted  to  "change 
agents".  They  should  be  involved  in  the  preparation  of  requests  for  proposals,  evaluation  of  proposals,  selec¬ 
tion  of  hardware  and  software  contractors,  functional  analyses,  etc.  It  is  particularly  important  that  these 
people  see  equipment  and  comparable  systems.  Those  who  will  have  major  roles  in  the  new  system  may  be  detailed 
to  work  with  the  developers. 

Other  staff  to  be  affected  need  education  in  the  concept  of  the  new  system,  information  on  the  plans  for  its 
development,  and  encouragement  to  help  carry  the  extra  load  the  development  entails.  They  also  need  to  be 
realistically  appraised  of  the  ‘Tinforglvlng"  nature  of  computers  with  regard  to  sloppy  inputs,  new  quality 
control  expectations,  and  new  procedures.  Some  detailed  planning  should  be  done  at  the  work  group  level.  As 
C.p.  Snow  (Ref. 19)  noted  with  regard  to  Tlzard’s  installation  of  Radar,  "To  get  anything  done  by  any  highly 
articulated  organization,  you  have  got  to  carry  peopl,:  at  all  sorts  of  levels,  it  is  their  decisions,  their 
acquiescence  or  enthusiasm  (above  all,  the  absence  of  their  passive  resistance),  which  are  going  to  decide 
whether  a  strategy  goes  through  in  time. " 

The  new  system  will  probably  involve  high  levels  of  conflict,  either  with  large  segments  of  the  organization, 
with  informal  work  groups,  or  with  individuals.  An  attempt  to  ‘T>aper  over"  these  conflicts,  an  attempt  to 
solve  or  resolve  them  by  dictatorial  edict  or  other  efforts  that  do  not  contain  the  element  of  negotiation  are 
likely  to  result  in  major  problems  in  the  systems  development.  The  signs  of  conflict  are  usually  relatively 
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clear,  it  one  Is  willing  to  see  them.  Persistent  failures  to  agree,  delays  in  acting  on  important  paperwork  in 
the  systems  development,  refusal  to  provide  inputs,  the  maintenance  of  parallel  systems  generally  with  better 
information,  and  refusal  to  use  a  new  system  are  all  obvious  resistances.  Less  obvious  perhaps  are  those  kinds 
of  resistance  that  attempt  to  kill  a  system  with  kindness;  the  insistence  that  it  move  promptly  from  research 
and  development  into  operation  is  only  too  common,  as  is  the  Insistence  on  rapid  changes  even  before  operation 

of  the  system.  Such  conflicts  must  be  faced  and  resolved  if  the  system  is  to  succeed. 

Ihis  description  had  focused  on  the  problems  of  the  developer;  it  is  only  fair  to  note  that  the  future 
user  may  also  have  realistic  objections  to  the  new  system.  Technological  enthusiasms,  power  hunger,  know-it-all 
attitudes,  and  small  errors  on  the  part  of  the  developers  also  must  be  avoided.  Another  paper  could  easily  be 

written  for  users  on  how  to  avoid  unrealistic  and  rigid  systems,  but  that  would  be  for  a  different  audience  and 

about  some  other  developers. 

In  any  event  the  way  of  the  reformer  is  not  easy.  As  Machiavelll  (Ref.  9)  observed  half  a  century  ago,  "It 
must  be  considered  that  there  is  nothing  more  difficult  to  carry  out,  nor  more  doubtful  of  success,  nor  more 
dangerous  to  handle,  than  to  initiate  a  new  order  of  things.  For  the  reformer  has  enemies  in  all  those  who 
profit  by  the  old  order,  and  only  lukewarm  defenders  in  all  those  who  would  profit  by  the  new  order,  this  luke- 
'  nmess  arising  partly  from  fear  of  their  adversaries,  vdio  have  the  laws  in  their  favour;  and  partly  from  the 
1  credulity  of  mankind,  who  do  not  truly  believe  in  anything  new  until  they  have  had  actual  experience  of  it. 

Thus,  it  arises  that  on  every  opportunity  for  attacking  the  reformer,  his  opponents  do  so  with  the  zeal  of 
partisans,  the  others  only  defend  him  half-heartedly,  so  that  between  them  he  runs  great  danger.  It  is  necessary, 
however,  in  order  to  Investigate  thoroughly  this  question,  to  examine  whether  these  innovators  are  independent, 
or  whether  they  depend  upon  others,  that  is  to  say,  whether  in  order  to  carry  out  their  designs  they  have  to 
entreat  or  are  able  to  compel.  In  the  first  case  they  invariably  succeed  ill,  and  accomplish  nothing;  but  when 
they  can  deper ^  on  their  own  strength  and  are  able  to  use  force,  they  rarely  fail.  Thus,  it  comes  about  that 
all  armed  prophets  have  conquered  and  unarmed  ones  failed;  for  besides  what  has  been  already  said,  the  character 
of  people  varies,  and  it  is  easy  to  persuade  them  of  a  thing,  but  difficult  to  keep  them  in  that  persuasion.” 
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SVMHARV 


Hie  problen  of  staffing  an  Inforaatlon  service  during  the  transition  from  the  mb  'ual  to 
an  automated  system  is  analyzed.  The  stages  of  development  are  first  presented  in  detail 
so  as  to  indicate  the  re-education  of  all  levels  of  staff  as  they  begin  to  realize  the 
pay-offs  possible  from  such  a  system  and  the  demands  it  will  make  of  its  exploiters  if  the 
possibilities  are  to  be  realized. 

Of  the  development  strategies  possible,  DSIS  chose  to  emphasize  that  in  which  the  w>  k 
is  carried  out  co-operatively  between  the  internal  staff  and  consultants  external  to  t 
organization.  This  helps  to  minimize  difficulties  with  internal  staff,  by  ens'.?n'ng  the 
involvement  at  all  times  so  that  they  feel  the  system  being  developed  is  their  own.  To 
optimize  the  man-machine  system  it  is  necessary  to  restructure  the  organization  to  make 
best  use  of  the  special  (jualitles  of  each  of  the  principal  elements.  Method,  are  practical 
in  small  manual  systems  in  which  there  are  no  true  specialists  and  everyone  does  a  little 
of  everything.  This  approach  must  he  ratiopxllzed  during  automation  to  ensure  that  tht.  e 
are  no  weak  links  in  the  system. 

After  the  preliminary  stage  .n  which  the  general  concepts  were  tested  inhouse,  ihere 
have  been  about  equal  numbers  of  co-'.puter-related  staff  in  DSIS  and  supplied  by  'oniractors, 
though  the  balance  of  expertise  is  «ith  the  latter. 


SOKHAIRE 


L’  auteur  analyse  le  probltae  qul  conslste  A  pourvolr  en  personnel  un  service  d'  informa¬ 
tion  pendant  la  phase  de  transition  entre  on  systAme  manual  et  uc  syst^."  automatlsd.  II 
prdsente  d' abord  en  ddtail  les  4t^)es  d'un  tel  ddveloppement.  de  fa9on  A  donner  une  idde 
du  recyclage  du  personnel  A  tous  les  niveaux,  lorsque  celul-ci  commence  A  prendre 
conscience  des  avantages  possibles  offerts  par  un  systAme  de  ce  genre,  et  des  exigences 
imposdes  i  ceux  qul  1' exploitent  si  ces  pcssibllltds  se  concrdtlsent. 

Des  diffdrentes  strategies  possible,  le  DSIS  a  cholsl,  pour  la  mett.'e  en  relief,  celle 
oO  le  travail  est  effectud  en  cooperation  par  le  personnel  intdrleur  et  des  consultants 
exterieurs  i  1' organisation.  Cette  solution  aide  4  rddulre  au  minimum  les  difficultes 
survenant  avec  le  personnel  intdrieur,  en  assurant  a  tout  moment  leur  implication  et,  par 
consequent,  en  crdant  chez  eux  le  sentiment  que  le  systAme  mis  au  point  leur  appartlent. 

Si  I’on  veut  perfectlonner  ie  systAme  honme-sachine,  il  faut  restructurer  r organisation 
pour  utlllser  au  mieux  les  qualltds  speciflquea  de  chacun  des  dldaents  princlpaux.  Les 
mdthodes  soot  pratiques  dant  ce  petlts  systAaes  aanuels  pour  lesquels  11  n’ya  pas  de 
vdritablee  spdciallstes,  et  oil  chacun  fait  un  peu  de  tout.  Cette  mdthode  d’approche  pent 
dtre  ratlonalisde  en  coura  d' automat 1 nation  pour  dviter  que  le  aystAme  ne  coaporte  des 
malllooB  falbles. 

AprAs  le  ntade  preilminalre,  au  coura  duquel  les  concepts  gdndraux  ont  dtt  mis  4  I'essal 
au  sein  de  la  societd,  on  a' est  trouvd  en  face  d'un  nomhre  4  peu  prAs  dgai  d'nnployda 
appartenant  4  la  DSIS  et  de  personnel  eous  contrat,  blen  que  le  bagage  technique  de  ces 
demiers  alt  dtd  aupdrleur. 
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FINDING  THE  OPTIHUH  HIX  OF  STAFF  AND  CONSULTANTS 
G.  X.  Ane; 


1.  THE  PROBLEH 

It  is  desired  to  transfora  the  staffing  of  a  aanual  docuaentation  aystea  into  that  required  by  an  inforaation 
systen  based  on  tbe  use  of  coaputers.  Ibis  calls  for  essential  changes  in  the  staff  organization  as  well  as  in 
the  total  number  of  staff  during  each  phase  of  the  transition.  In  order  to  trace  these  changes  within  the 
system,  the  growth  and  development  of  the  systen  Itself  must  be  considered.  This  is  covered  fully  in  ay  paper 
“Evolutionary  Transition  to  Autonation  of  Inforaation  Hanageaent'*  (Ref.  1). 

Evolution  of  the  Systen 

The  transformation  of  the  systen  is  usually  divided  into  a  number  of  stages  in  each  of  which,  naebine- 
interactlon  Increases  and  staff>roles  are  nodifled  to  aake  wore  effective  use  of  tbe  conputer  as  understanding 
of  its  merits  and  shortcomings  are  appreciated.  Each  stage  will  tend  to  continue  in  parallel  with  the  new 
stage  for  some  tine  during  a  transition  peric*  as  shown  in  Figure  1. 

In  the  first  stage,  the  conputer  involvenent  is  likely  to  be  as  a  nere  aodendun  to  the  systen.  Since  the 
formation  of  a  data  base  is  a  prine  requisite  for  operation  of  an  automatic  retrieval  systen,  this  task  nay  be 
undertaken  long  before  there  is  any  possibility  of  extracting  benefits  frtsn  the  systen.  This  stage  also  brings 
the  painful  realization  of  how  important  absolute  accuracy  is  in  dealing  with  a  machine.  Our  ona  experience 
provides  an  excellent  example  of  improper  use  of  coaputers  in  which  Just  one  element  of  the  manual  systen  is 
replaced  by  a  mechanical  equivalent.  Re  initially  developed  a  method  for  automatic  selective  dissemination  of 
catalogue  cards  printed  on  IBM  tab  cards.  This  proved  to  be  sore  cumbersome  than  the  aanual  sorting  operation 
currently  used  so  that  the  nethod  was  not  worth  iapleaentlng. 

In  the  second  stage  of  development,  we  have  oade  good  use  of  tbe  capabilities  of  coaputers  for  sorting  and 
rearranging  data  in  formatting  and  indexing  our  announceaent  services.  Ibis  allowed  seme  snail  savings  ot 
clerical  effort  but  the  principal  payoff  is  a  reduction  of  effort  in  processing  classified  docuients  plus  the 
addition  of  indexes  to  our  announceaenta.  In  computer  terns  this  is  a  batched  operation  which  will  not  be 
ubsoleted  by  further  developaent  of  the  system. 

We  shall  finally  reach  a  stage  where  the  machine  is  fully  Integrated  into  the  system  and  acts  as  a  synbimt 
of  the  staff.  In  Figure  2  DSIS  is  a  black  box,  BB2,  idilch  receives  Inputs  from  suppliers  of  inforaation  and 
provides  outputs  to  final  users.  Neither  the  source  or  the  user  need  concern  Itself  with  the  internal  operation 
of  the  black  box.  Within  D61S  there  is  a  second  black  box,  BBl,  the  online  automatic  system  which  accepts  a 
variety  of  inp  its  and  provides  complex  outputs  according  to  set  rules.  Tbe  evolution  of  this  bl.tck  box 
determines  the  changing  requirements  of  the  staff  interacting  with  it. 


2.  STRATEGIES  OF  STAFF  EVOLUTION 

Turnkey  Systems  -  Hininal  lavolvememt  of  Internal  Staff 

Tbe  attractive  approach  in  terns  of  economics  and  avoidance  of  administrative  headaches,  is  to  buy  a 
turnkey  system.  Ibis  implies  that  somebody  has  already  developed  a  system  which  appears  to  fit  your  require¬ 
ments.  In  the  most  extreme  case,  machine,  system  and  staff  are  supplied  as  a  package,  am  in  the  came  of  NASA, 
where  only  two  neobera  of  NASA  staff  are  needed  to  oversee  daily  operations  of  the  information  servicea.  A 

nuch  larger  staff  is  of  course  required  to  define  and  continuously  evaluate  such  a  system.  The  NASA  system  wss 

tailored  to  their  requirements  and  is  so  excellent  example  of  so  operstlonsl  large  scale  systen.  More  usually 

the  problen  is  to  convert  an  existing  manual  system  and  there  is  no  turnkey  aystea  available,  wF'cb  is  tailored 

to  the  specific  needs  of  the  user.  Painful  and  expensive  modifications  are  required  to  oske  the  two  systems 
fit. 

Systems  of  this  kind  which  are  almost  entirely  developed  by  computer-oriented  people,  betray  their  origin  by 
provision  of  services  and  requiring  Inputs  which  are  esmentlally  computer-orlanted  rather  than  directed  towards 
needs  of  the  ultlnate  users  of  the  aystem. 

Characteristics  of  such  aysteew  include  tbe  following;  rigid  definition  and  fomatlng  of  inputting;  report 
generators  which  produce  only  tabulations:  use  of  printout  in  upper  case  only;  provision  of  cryptic  messages  to 
the  user,  and  over-reliance  on  the  aystem  to  nakc  what  are  essentially  intellectual  declslans.  The  system  is 
essentially  a  black  box  with  an  elegant  iateraai  structure  but  unfitted  la  both  input  amd  output  to  bumao  users. 
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llie  last  elenent  of  conputer  perforaance  is  extracted  froa  the  systea  hy  'jlt>diddling  and  tailoring  the  system 
to  the  particular  configuration  used.  Expansion  and  development  of  the  sysieia  is  very  difficult  and  transfer 
to  a  different  make  of  c«q)uter  is  impossible. 

DevelopMnt  Shared  by  Internal  Staff  and  Consultants 

The  more  usual  route  is  to  involve  internal  staff  heavily  in  the  design  of  the  system,  using  external 
consultants  to  provide  specialized  computer  knom-hos.  le  are  the'’  confronted  with  the  problem  of  deciding  the 
degree  of  involvement  of  internal  staff  in  this  procedure  in  order  to  facilitate  coaaunication  between  them  and 
the  consultants.  Your  staff  must  become  acquainted  with  computer  technology  and  the  consultants  must  become 
experts  in  your  system.  Provision  of  Inhouse  expertise  in  the  computer  fields  means  either  your  st.iff  must  be 
retrained  or  new  staff  with  the  required  skills  must  be  hired.  Addition  of  staff  goes  contrary  to  the  rationale 
of  using  coq)uters  -  which  are  generally  claiaed  to  reduce  staff.  Retraining  pre-supposes  that  current  staff 
are  capable  t.  f  absorbing  computer  skills  at  a  speed  sufficient  to  enable  continuing  usefulness  in  the  organiza¬ 
tion.  Normal  production  must  continue  despite  diversion  of  effort  to  development  activity. 

Contribution  of  the  System  User  to  Design 

The  third  strategy  in  the  develop^nt  of  a  system  is  that  of  involving  the  user  in  the  system.  This  appears 
necessary  if  it  is  to  supply  his  needs:  otherwise  the  system  will  probably  be  optimized  from  the  viewpoint  of 
the  information  staff.  TO  involve  the  users  in  the  SOCRATSS  system,  annual  conferences  of  librarians  and 
information  scientists  have  been  held  since  1966:  evaluation  questionnaires  have  been  employed  and  the  informa¬ 
tion  scientists  visit  their  main  aggregations  of  users  across  Canada  each  year.  More  direct  involvement  in 
detailed  design  is  difficult.  Experiments  in  automated  retrieval  have  been  conducted  at  several  establishments 
(Ref. 21,  and  one  of  our  more  sophisticated  users,  after  developing  an  SDI  system  for  CAS  tapes  has  become  head 
of  the  computer  division  of  DSIS. 


3,  INVOLVEMENT  OF  INTERNAL  STAFF  IN  SYSTEM  DESICN 

We  chose  the  second  method  described  above.  The  introduction  of  an  automated  system  will  have  direct  effects 
on  the  policy  and  organization  inherent  in  the  existing  system 

Impact  no  Policy 

Policy  in  relation  to  reproduction  had  to  be  reconsidered  at  DSIS.  A  system  iWtich  has  a  response  of  several 
weeks  to  a  request  for  information,  is  tolerable  in  a  purely  manual  system.  In  en  online  system,  where  response 
to  a  query  to  the  computer  is  a  matter  of  seconds,  the  mechanism  for  supplying  documents  must  also  be  fast.  .At 
DSIS  it  is  planned  to  supplant  hard  copy  in  favor  of  microfiche  since  the  latter  can  be  reproduced  much  cheaper 
and  faster.  Thus  one  day  tum-around  to  a  request  should  be  possible  if  microfiche  is  supplied  by  DSIS. 

Storage  of  microfiche  at  DRB  establishments  will  give  stilt  faster  response  to  local  users. 

Organiaatlooal  Changes 

The  system  based  or.  specialization  of  subject  rnther  than  function  is  at  a  disadvantage  when  associated  with 
machines.  If  the  information  scienttat  normally  Indexes  and  abstracts  documents,  prepares  and  updates  profiles, 
conducts  searches,  etc  ,  within  a  narrow  subject  ares,  then  his  absence  for  several  weeks  will  introduce  delays 
of  this  order  into  a  system  that  Is  designed  to  respond  in  seconds. 

In  addition,  specialisation  in  subjects  rather  than  functions,  inevitably  causes  .suijective  indexing  of 
material,  which  in  turn  makes  much  of  the  asterisl  difficult  to  ret.'ieve  by  anyone  other  than  the  original 
Indexer.  Thia  la  intuleraole  in  an  online  ayslem  where  the  user  can  browae  directly  >n  the  surrogate  files 

New  categories  uf  staff  will  come  into  existence.  If  no  explicit  planning  group  was  in  existence  previously 
one  should  be  formed  in  order  to  define  long  range  goals  and  provide  an  interface  between  outride  consultants 
and  internal  staff.  This  group  sill  specify  s  system  and  control  and  evaluate  the  work  carried  nut  by  external 
consultants.  New  divisions,  concerned  with  operation  of  a  computer  sad  its  peripherals,  must  be  defined  and 
staffed 


4.  STAFF  INC  EirERIENCE  AT  DSIS 

The  tot  il  staff  of  70  (including  publication)  in  1966  has  not  changed  in  the  interim,  although  several  new 
positions  nave  been  added  Figure  3  shows  the  five  year  protection  of  staff  requirements  used  in  telling  the 
plan  to  msysgement  The  rising  straight  line  indicates  extrapolation  of  expected  work  load  in  terms  of  input 
of  informs. ion  The  ur>pcr  line  indicates  total  staff  rcqulrcmehts  during  the  transition  and  the  lower  line 

shows  grow'.b  of  coaqyuter  operating  staff  internal  to  0616.  We  have  nos  added  five  of  the  seven  computer  staff 
planned,  end  all  were  recruited  inbouae.  either  b.v  retraining  in  DSIS  or  by  irrnisfer  from  some  other  part  of 
DRB  Detailed  changes  of  non-computer  stuff  are  shomi  below 
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Inputting 

(a)  Descriptive  cataloguing  now  requires  rigid  definition  of  the  nearly  fifty  categories  of  bibliographic 
data  defined.  A  aeober  of  this  staff  is  now  employed  in  proofreading  data  to  be  entered  on  magnetic  tape. 

(b)  Hie  tasks  have  been  rationalized  so  that  particular  girls  carry  out  specific  duties,  rather  than  each 
person  doing  a  little  of  each  type  of  task.  Backup  provisions  are  made  to  cope  with  the  problem  of  absence. 

Ihe  system  is  planned  so  that  Inputting  has  preserved  the  same  form  from  the  time  the  data  was  typed  ->0  work 
cards,  through  the  stage  (now  being  phased  out)  of  producing  paper  tape  on  flexowriter,  to  the  current  stage  of 
online  entry  of  data  on  magnetic  tape. 

(c)  Analytic  cataloguing  has  been  modified  only  to  the  extent  of  replacing  the  subject  headings  of  the 
original  DSIS  system  by  TEST  descriptors  and  COSATI  categories.  Deeper  indexing  and  unlimited  abstract  length 
are  now  practical.  There  has  been  a  231  saving  in  documents  processed  for  the  information  scientists  bv  the 
use  of  the  KROC  index  to  announce  unclassified  material  which  is  well>indexed  elsewhere. 

Outputting 

The  main  outputs  of  the  system  are  printed  announcements,  and  documents  distributed  either  on  request,  or  on 
a  selective  basis  as  received.  Automatic  formatting  and  paging  of  the  announcement  service  saves  some  effort 
in  the  print  shop.  Internal  production  of  microfiche  may  eventually  call  for  increase  of  staff  in  the  micro- 
photography  section. 


S.  THE  CONTRIBUTION  OF  CONTRACT  STAFF 

Dammers  (Ref. 3)  has  found  that  it  is  better  to  do  all  development  internally,  retraining  one’s  own  staff  to 
carry  out  new  tasks.  This  has  not  been  possible  at  DSIS  and  we  have  relied  on  consultants  to  carry  most  of  the 
design  load,  fe  have  tried  both  of  the  approaches  to  contracting  which  were  discussed  earlier,  functional 
specification  of  a  system  which  is  then  implemented  by  us  (Ref. 4):  and  the  use  of  consultants  as  an  extension 
of  our  own  staff  (Refs.  5,6).  The  latter  method  has  been  more  satisfactory,  since  the  consultants  then  Interact 
directly  at  all  levels  of  DSIS  staff  to  ensure  that  impractical  ideas  are  not  incorporated. 

Contract  Control  Documentation 

Our  method  of  Job  specification  ia  designed  to  provide  thorough  documentation  of  the  work  being  performed  at 
all  stages  of  system  analysis,  coding,  debugging  and  implementation.  A  conceptual  analysis  is  first  made  by 
DSIS  planning  staff  of  the  problems  to  be  tackled  in  any  given  fiscal  year,  in  accordance  with  the  five-year 
plan.  The  Project  Officer  receives  a  job  description  for  each  of  the  tasks  in'‘'ylved,  with  estimates  of  the 
'ffort  required  and  expected  completion  dates.  Priorities  are  then  set  so  as  to  ensure  smooth  operation  of  the 
current  phase  of  the  system  mhile  introducing  improvements  on  the  basis  of  experience.  Changes  in  agreed 
schedules  have  to  be  approved  by  D31S. 

Pitting  developmetii  work  into  (he  fiscal  year  has  been  our  greatest  headache.  Changing  government  policy 
with  respect  to  use  of  ctMtractors  as  c-itenslons  of  one's  own  staff,  has  contributed  to  our  difficulties. 
However,  we  feel  that  we  have  made  the  best  possible  use  of  our  own  resources  by  this  contribution  of  contrac¬ 
tors  and  internal  staff 


1  Amey.  O  X. 
Ame).  C  X 

2  Currie.  D  J 

Mrlvor.  R  A 

3  Daeeers.  H  P 

4  Brown  HP! 

5  Hi>xhaa.  J  C 

6  Grant.  R  • 
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SUMMARY 


A  coouDent  is  presented  on  hardware  choice  and  its  probleos  in  the  light  of  the  experi* 
ence  gained  in  the  development  of  computerized  information  facilities  at  the  Shell  Research 
Laboratories,  Sittingboume,  UK.  The  environment  in  which  the  system  operates  is  outlined 
as  well  as  the  objectives  of  the  project  and  resources  available.  Computer  configuration 
for  data  storage  and  retrieval  operation  at  the  site  and  links  to  other  computers  in  the 
Company  are  described  and  the  cost/effectiveness  ratio  of  the  different  operations  is 
established.  Finally  future  needs  and  developments  are  discussed. 


SOMMAIRE 


L’ auteur  dtudie  le  choix  de  I’^quipement  et  les  problftmes  qu’ il  soul&ve,  A  la  lumifere 
de  1’ experience  acquise  an  cours  de  la  mise  sur  pied  de  services  d’ information  equipts  d’un 
ordinateur,  aux  laboratoires  de  recherche  de  la  SHELL,  i  Sittingboume,  Grande  Bretagne. 

II  donne  un  aperqu  de  1' environnement  du  systJme  ainsi  que  des  objectifs  du  projet  et  des 
ressources  disponibles.  II  ddcrit  ensuite  la  configuration  d’ ordinateur  propre  aux 
operations  de  mise  en  memoiro  et  de  localisation  d’ informations  sur  place,  ainsi  que  les 
liaisons  avec  les  autres  ordinateurs  de  la  Compagnie.  II  determine  la  rentabilite  des 
differentes  operations  et  conclut  en  analysant  les  b.2soins  et  les  developpements  de  1’ avenir. 
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AUTOMATION  OF  THE  INFORMATION  SERVICE  IN  AN  INDUSTRIAL  RESEARCH  ESTABLISHMENT; 
HARDWARE  AND  ITS  EFFECT  ON  IMPLEMENTATION  AND  PERFORMANCE 

H.P.  Daumiers 


1.  INTRODUCTION 

Ihe  attitude  of  computer  users  and  operating  staff  with  regard  to  hardware  matters  tends  to  be  a  rather 
ambivalent  one.  On  the  one  hand,  one  can  validly  take  the  line  that  hardware  matters  are  of  relatively  little 
consequence,  as  with  our  present  facilities  the  main  bottlenecks  tend  to  be  in  the  software  area.  On  the  other 
hand,  constraints  imposed  by  our  available  hardware  capabilities  or  incapabilities  nre  often  all  too  evident 
and  constitute  not  infrequently  a  source  of  severe  frustration.  > 

Hardware  limitations  were  probably  the  major  barriers  to  overcome  in  the  application  of  computers  to  prac¬ 
tical  information  storage  and  retrieval  systems,  and  it  is  perhaps  fair  to  state  that  only  with  the  arrival  of 
second  generation  computers,  such  as  the  IBM  1401  early  in  the  sixties  which  combined  satisfactory  character 
handling  and  peripheral  capabilities,  did  computer  use  In  this  field  be  to  make  real  progress.  There  is 

little  doubt  that  the  1400  series  has  proved  to  be  successful:  in  fact,  y  became  so  dominant  that  many  360’ s 

are  still  likely  to  be  simulating  or  emulating  them.  Some  mechanised  documentation  centres  have  even  chosen  to 
continue  using  this  type  of  installation  rather  than  to  move  to  later  models  (aiD,  Prankfurt/Main). 

Most  of  those  who  have  been  concerned  y;ith  computer  use  in  information  retrieval  in  the  mid-sixties  are 
likely  to  have  been  involved  at  one  time  or  another  with  1401  Autocoder  programs.  It  is  an  indication  of  the 
impact  which  can  be  made  by  a  particular  piece  of  hardware  or  hardware  configuration. 

It  has  been  mentioned  earlier  that  software  rather  than  hardware  may  be  at  present  the  factor  limiting 
efficient  exploitation  of  our  existing  computer  facilities,  i.e.  hardware  development  appears  to  outrun  our 
capability  to  apply  it  to  our  best  advantage  -  a  situation  which  is  perhaps  characteristic  for  much  of  modem 
technology  and.  its  relation  with  society. 

Ihe  speed  with  which  harnware  performance  is  improving  has  been  clearly  indicated  by  Knight’’*'^.  His 
analysis  evaluated  about  250  general  purpose  computer  systems,  covering  roughly  the  first  two  decades  of  the 
computer  industry,  and  it  showed  that  as  regards  cost/performance  (number  of  operations  per  dollar)  computers 
have  been  improving  by  80-90%  per  year  for  commercial  computations.  If  one  adds  to  this  the  fact  that  Invest- 
jient  in  computers  increases  by  20-30%  per  year,  it  suggests  that  available  computer  capacity  must  be  roughly 
doubling  each  year  or  increasing  lOOO-fold  in  a  decade.  His  analysis  also  upheld  Grosch's  law*.  Evaluation  of 
future  trends  in  hardware  development  (Joseph")  suggests  that  the  pace  is  not' likely  to  slacken  much  during 
the  forthcoming  decade.  This  situation  is  somewhat  dramatically  represented  in  Figure  1  (Ref. 5).  One  might 
add  that  whi'  .1  our  society  is  gc.ired  to  the  type  of  progress  indicated  by  A,  it  cannot  as  yet  cope  adequately 
with  a  development  such  as  that  indicated  by  B.  This  continued  rapid  development  makes  it  difficult,  if  not 
virtually  impossible,  to  decide  with  some  measure  of  certainty  on  the  hardware  configuration  economically  and 
ooerationally  !>BSt  suited  to  one's  requirements  for  the  next  2-3  years,  the  more  so  as  delivery  dates  for  the 
latest  types  of  ^  puter  hardware,  in  particular  peripheral  equipment,  tend  to  be  unreliable.  As  a  result  of 
these  conditions,  ine  selection  of  hardware,  which  alms  to  meet  the  criteria  of  opti.wum  coet/performance, 
satisfactory  delivery  date  and  compatability  with  existing  equipment,  tends  to  become  a  rather  hazardous  problem 
allowing  as  its  usual  solution  only  a  compromise  of  one  form  or  another. 


2.  DEVELOPMENT  AT  SHELL  RESEARCH  LTD.,  SITTINGBOURNE 

The  present  paper  is  intended  to  comment  on  hardware  choice  and  its  problems  i."  the  light  of  the  experience 
gained  in  the  development  of  mechanised  information  facllltiea  at  the  Shell  Research  Laboratories,  Sittlngboume. 
(t  is  therefore  de'irable  to  outline  the  environment  in  which  we  operste,  the  objectives  ws  hsve  to  meet  and 
the  resources  avsilsblc  etc. 

The  Sittlngboume  Lalioratortes  are  a  group  of  Laboratories  which  deal  predominantly  with  biology-oriented 
rescerch  (Fig. 2),  even  though  perhaps  70%  of  its  research  activities  fall  within  the  broad  dlaclpllnes  of 
chemistry  (organic  and  i^iyslcal)  and  biochemistry.  As  a  result,  much  of  the  technical  information  activities 
has  been  concerned  with  the  handling  (storage  and  i-etrleval)  of  chemical  information  and  lesearch  data. 


•  Herb  Oroech  sussected  in  the  late  1940a  that  cuaputer  power  Incrrtaes  as  the  svwri  of  cost.  The  so-called  Oroech'a  law 
may  well  be  so  artifact  of  the  computer  aanufsctui-ere'  pricing  policy. 
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The  group  dealing  with  such  activities  is  the  Technical  Inforaation  Services,  which  are  responsible  not  only 
for  library/information  services  but  also  for  the  provision  of  digital  coaputer  facilities  on  the  site.  The 
group  has  developed  fairly  rapidly  s.iice  its  very  aodest  beginnings  in  1S56  (Pig.  3)  and  is  perhaps  rather 
unique  in  its  potential  to  achieve  an  effective  integration  of  infomstion  service  and  coaputer  processing 
facilities.  The  gain  iupetus  for  the  application  of  coaputers  in  Info  atlon  storage  and  retrieval  arose  from 
the  need  to  create  effective  infr-aation  storage  and  retrieval  faclllti.s  for  our  research  data. 

In  1962  it  was  decided  to  move  towards  a  centralised  system  involving  the  use  of  computer  facilities.  The 
main  stages  in  this  development,  which  resulted  in  applying  the  experience  gained  in  research  data  handling 
also  in  the  field  of  published  and  report  literature  handling,  are  displayed  in  Figure  4.  This  figure  is  a 
modified  version  of  one  given  in  an  earlier  paper  in  1967  (Ref. 6).  We  appear  not  to  have  deviated  too  much 
from  the  course  then  predicted  although,  as  one  might  expect,  we  have  slipped  roughly  a  year  in  the  implementa¬ 
tion  of  some  projected  activities,  mainly  because  we  were  too  optimistic  with  regard  to  the  Impact  of  time¬ 
sharing  or,  perhaps  more  correctly,  we  not  only  believed  too  readily  the  statements  made  by  the  computer  manu¬ 
facturers  regarding  the  delivery  and  cost  effectiveness  of  their  systems  but  also  we  may  have  been  inclined  to 
take  on  rather  more  than  we  could  conveniently  cope  with. 

Also  as  shown  in  Figure  5,  we  have  been  using  a  variety  of  machines  since  1962  with  its  obvious  corollary  of 
changes  in  programming  languages.  However,  it  must  be  conceded  that  as  a  result  of  it  all  we  now  appear  to  have 
the  benefit  of  a  system  that,  although  still  developing,  has  already  proved  to  be  very  attractive  from  the 
operational  point  of  view. 

The  present  system,  insofar  as  it  affects  us  at  Sittingbourne,  is  schematically  outlined  in  Figure  6.  Hence 
we  have  available  on  site  a  small-to-medtum  size  computer  installation,  the  Univac  9300,  which  can  be  used  as  a 
free-standing  system,  suitable  for  file  handling  and  data  reduction  jobs  requiring  modest  processing  power,  and 
it  can  also  operate  as  a  terminal  to  the  powerful  Univac  1108  system  in  Shell  Centre,  London.  Through  this  we 
also  have  access  to  the  360  system  and  for  transmission  purposes  to  other  locations  connected  to  the  network. 

Figure  7  gives  an  indication  of  the  type  of  information  retrieval  operations  wh^ch  are  now  handled  via  our 
computer  system.  Some  aspects  of  the  system  now  in  operation  have  been  described  in  various  earlier 
papers^ ,8 ,9 , lo 

Rather  than  discuss  these  systems,  their  method  of  operation  and  the  reasons  for  their  implementation 
specifically,  it  seems  appropriate  co  discuss  urder  a  few  general  headings  the  experience  gained  in  implementing 
them. 


3.  LARGE  versus  SMALL  MACHINES 

Mention  was  made  earlier  of  Grosch’s  law,  l.e.  the  fact  that  the  capacity  of  computers  appears  to  relate 
according  to  the  square  of  their  cost,  and  as  already  indicated,  this  "law”  is  likely  to  be  an  artifact  of  the 
pricing  policy  followed  by  computer  manufacturers  (it  does  seem  by  no  means  certain  that  it  will  also  apply  in 
future). 

It  has  given  rise  to  the  dictum  "the  larger  the  machine  the  cheaper  it  can  do  a  given  computing  job".  This 
is,  as  a  rule,  true  if  one  compares  the  processor  times  actually  devoted  to  job  execution.  However,  large 
powerful  processors  tend  to  be  input/output  bound:  this  does  not  seriously  affect  their  performance  when  dealing 
with  really  large  computational  jobs,  l.e.  jobs  in  which  very  substantial  computations  are  performed  on  a 
limited  volume  of  input  data,  to  yield  again  a  limited  volume  of  output  data.  The  situation,  however,  is  quite 

different  if  large  numbers  of  different  small  jobs  have  to  be  performed  or  when  the  input  consists  of  large 

files  of  data,  each  requiring  only  a  small  amount  of  proc^.ssing  Earlier  expectations  that  efficient  tiire 
sharing  systems  would  be  able  to  overcome  this  drawback  have  unfortunately  not  yet  been  realised.  Hence  it  is 

not  uncommon  to  find  that  for  small  scientific  jobs,  for  data  reduction  work  and  for  many  file  handling 

operations,  small  systems  tend  to  offer  better  cost/performance  than  large  machines.  This  trend  has  been  aided 
by  the  feet  that  a  considerable  number  of  small,  relatively  cheap  but  quite  powerful  coaputer  systems  have 
appeared  on  the  market.  Attractive,  small  scientific  computing  systems  can  now  be  obtained  in  the  range 
£5,000  -  £15,000  and  systems  of  the  type  required  for  inforaation  retrieval  activities  can  be  had  in  the  range 
£30,000  -  £75,000  The  ba.slr.  Sittingbourne  system,  considered  as  a  free-standing  unit,  would  fall  in  the  tup 
end  of  the  latter  range. 

Although  the  use  of  a  small-to-aedlum  size  system  maj'  be  economically  fully  justified  for  various  Jobs,  in 
particular  those  in  the  information  retrieval  area,  this  should  not  prevent  us  from  clearly  recognising  the 
drawbacks.  One  nay  have  to  use  Assembler- type  languages  in  order  to  get  the  full  benefit  from  the  small  machine 
and  this  nay  mean  re-programming  f  one  should  want  to  run  ti..  job  on  another  machine.  The  fact  that  one'.s 
staf*'  has  to  acquire  this  particular  programming  skill  is  an  additional  cost  factor,  even  though  time  to  program 
a  Job  is  probably  on  average  not  greater  than  if  a  high-level  language  such  os  Cobol  were  used.  (In  fact, 
skilled  programmers  tend  to  find  use  of  a  language  such  as  Cobol  rather  a  bore.)  Purthermoro,  one  is  not 
likely  to  accept  lightly  a  situation  where  a  job,  which  would  have  cost  5  minutes  on  the  largo  machine.  Is  tying 
up  several  hours  on  the  small  machine.  Labour  effort  (programming,  operating)  reijuirement  for  a  given  job  is 
perhaps  somewhat  less  favourable  for  the  smaller  than  for  the  larger  machines  (Fig.  8);  this  will  be  justifiable 
In  those  areas  where  the  small  coaputer  has  an  edge  over  the  large  one.  in  others  it  will  nut. 
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All  in  all  then  the  choice  is  a  coHplex  one  and  depends  on  the  type  of  job  and  the  type  of  access  acquired 

The  safest  course  and  the  nost  attractive  one  aould  appear  to  be  the  one  iaplenented  in  our  case  chere  one  has 
the  choice  between  running  the  local  systea  as  a  free-standing  unit  where  this  is  clearly  warranted  and  feasible, 
and  using  it  as  a  terminal  to  a  large  computer  system  in  all  other  cases. 


4.  ON-LINE  OPERATION  versus  USE  AS  FREE-STANDING  MACHINE 

The  foregoing  discussion  leads  us  to  look  more  closely  at  ways  and  means  of  using  an  on-line  machine. 

In  our  case,  the  Univac  9300  was  originally  conceived  as  a  local  data  collecting/editing  device  through  which 
site  peripherals  would  access  the  Univac  1108  which  was  expected  to  operate  under  a  multiprogramming  system, 
the  Exec  8.  This  system  would  allow  the  1108  to  be  used  concurrently  for  batch  processing,  for  rapid  response 
(demand  processing)  type  of  operation  as  well  as  for  real  time  operation.  Slippage  in  the  delivery  of  software 
with  the  performance  characteristics  required  meant  that  the  1108  remained  operational  under  batch  processing 
executives  Exec  II  and  later  Exec  III.  It  also  meant  that  local  equipment,  such  as  that  Installed  at  Sitting- 
bourne,  had  to  be  upgraded,  e.g.  via  provision  of  4  tape  units  Instead  of  2,  in  order  to  enable  it  to  execute 
Jobs  on  site  where  this  proved  desirable  for  cost  or  operational  (speed  of  access)  reasons. 

Operation  on-line  is,  of  course,  subject  to  multiple  hazards;  it  is  not  only  affected  by  failures  of  the 
local  equipment  but  also  by  any  mishaps  occurring  to  the  GPO  lines  and  the  central  computer  installation.  In 
our  case,  they  appeared  more  or  less  equally  responsible  for  loss  of  Jobs  or  access. 

We  also  found  that  the  9300  might  be  occupied  for  as  much  as  15-20  hours  for  every  hour  1108  time  used.  This 
obviously  made  for  inefficient  use  of  the  9300  or  alternatively  it  added  considerably  to  the  cost  of  1108  work. 

In  order  to  remedy  this  situation,  a  systeiu  modification  has  been  written  which  will  enable  the  9300/1108 
communication  to  be  handled  as  a  symbiont  operation*  and  this,  together  with  expansion  of  the  9300  memory  by 
16  K  to  32  K,  should  make  it  possible  to  reduce  the  time  during  which  the  9300  is  solely  occupied  in  communica¬ 
tion  with  the  1108  very  drastically  indeed.  The  improvement  in  9300  capacity  arising  from  the  more  efficient 
communication  should  just  about  pay  for  the  extra  cost  in  memory;  in  additiori,  of  course,  the  machine  has 
become  a  more  powerful  device  capable  of  dealing  more  efficiently  with  a  larger  range  of  jobs. 

One  of  these  jobs,  and  quite  an  Important  cne  to  us,  is  the  operation  of  our  SDI  system.  This  is  run  on  the 

9300  at  present  mainly  on  the  basis  of  CA  Condensates  tapes;  it  has  developed  into  a  rather  substantial  opera¬ 
tion  covering  the  use  of  150-160  search  profiles  (ca  1800  search  terms)  which  are  used  to  select  each  week 
ca  2000  references  (on  average  about  12  per  profile)  from  the  tapes  received  from  Chemical  Abstracts  Services, 
Columbus.  This  facility  is  now  used  by  the  great  mrjority  of  the  research  workers  in  the  Sittingboume  Labora¬ 
tories;  it  leads,  however,  to  a  substantial  load  (5-6  hrs  each  week)  on  the  9300.  This  load  was  fully  antici¬ 
pated;  in  fact,  we  feel  rather  proud  that  the  development  and  performance  of  the  system  proved  to  match  our 
prediction  so  closely.  However,  as  since  then  also  a  variety  of  other  Jobs  have  been  Implemented  on  the  9300, 
not  only  information  storage  and  retrieval  Jobs,  such  as  those  indicated  in  Figure  7,  but  also  a  variety  of  jobs 
concerned  with  processing  of  instrument  output,  one  is  obviously  anxious  to  reduce  such  large  loads.  This  will 
be  achieved  by  utilising  to  the  full  the  speed  improvements  potentially  available  as  a  result  of  larger  memory. 
Passing  the  job  onto  the  larger  computer  has  as  yet  operational  disadvantages  (e.g.  load  on  data  transmission) 
but  this  might  eventually  well  come  about.  At  the  same  time,  there  is  a  tendency,  as  a  result  of  the  avail¬ 
ability  of  very  cheap,  small  computers,  to  take  processing  of  some  of  the  instrument  output  away  from  the  site 
computer  and  carry  it  out  near  the  source  Hence,  we  apnear  to  be  moving  towards  a  3-level  system,  l.e.  pro¬ 
cessing  at  source,  on  the  site  computer  and  on  the  larg  itral  computer  wstem. 

The  de\  'lopment  of  this  approach,  as  well  as  the  appropriate  volume  of  usage  at  each  level,  will,  one  expects, 
be  guided  by  the  combined  objectives  of  meeting  user  requirements,  particularly  as  regards  access  (turn-around 
time),  and  lowest  cost  for  equipment  or,  in  other  words,  one  tends  to  strive  towards  maximum  productivity  from 
the  combined  resources  of  labour  and  equipment  This  tends  to  guide  also  the  usage  of  existing  equipment. 

For  Instance,  with  regard  to  the  development  of  new  applications,  it  may  be  preferable  to  do  this  in  some  cases 
direct  on  the  large  machine,  which  may  have  the  various  routines  required  in  this  work  already  available;  In 
other  cases,  however,  particularly  nun-numeric  Jobs,  one  may  well  find  that  development  work  can  nost  conveni¬ 
ently  be  done  on  the  smaller  ciimputer,  to  be  followed  by  implementation  on  the  large  computer  when  the  Job 
becomes  fully  operational. 

Much  depends  here  on  convenience  of  manipulation  and  access.  In  connection  with  this,  it  may  be  of  intereat 
to  show  how  access  tc  computer  facilities  and  the  volume  of  c.omputer  usage  at  Cittingboume  have  developed 
during  the  past  six  years  (fig.  9)  This  figure  is  a  mndifled  version  of  one  given  in  an  earlier  (1967)  paper*. 
The  original  version  reflected  the  expectation  that  response  time  would  sharply  improve  during  1967/68  as  a 
result  of  the  inplementstlon  of  Exec  8  on  the  Ur.lvat:  1108  oystem.  This  has  not.  as  yet,  materialised  and  it 
is  of  interest  to  note  that  the  improvement  in  response  time  we  actually  did  achieve  does  fit  in  much  more 
smoothly  with  the  gradual  progress  made  during  1863-87  Large,  complex  systems  rarely  change  drastically,  they 
evolve. 


A  syablunt  is  is  Independent  routlse.  which  trtasfers  data  between  s  periimenl  wait  Md  en  iatemedlite  storage  median 
such  ss  s  drua. 
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In  order  to  diiplnj  More  directly  tbe  relntion  octeeen  response  tlae  sod  cowtiter  usace,  the  data  in  Pifure  9 
sere  used  to  provide  the  (rap)i  plotted  in  Pifure  10.  Ihere  is,  in  our  vies,  kittle  doubt  that  isproveaent  of 
access  sets  as  s  powerful  stinulus  in  coaputer  application. 


5.  STORAGE  FACILITIES 

In  an  account  on  coaputer  hardware  relating  to  inforaation  retrieval  work,  storage  facilities  obviously  ought 
to  figure  proainently.  If  they  do  not  in  the  present  paper,  it  is  because  we  have  in  inforaation,  storage  and 
retrieval  work  little  experience  to  offer  beyond  the  use  of  aagnetic  tapes. 

Magnetic  tapes  are  obviously  the  aalnstay  as  regards  storage  in  any  coaputer  operated  Information  storage  and 
retrieval  systea;  the  storage  aediua  is  cheap,  i.e.  say  10  shillings  :per  Billion  characters  stored,  and  aagnetic 
tape  units  are  now  reliable  and  sophisticated  pieces  of  aachinery,  allowing  the  tapes  to  be  scanned  at  speeds 
varying  froa  30,000  cps  to  300,000  cps  and  over.  Tape  densities  have  been  steadily  going  up,  1,600  bpl  is  now 
being  offered  on  most  tapes  (equivalent  to  say  30  aillion  characters  per  3,400  ft  reel  of  tape)  and  it  is 
expected  that  10,000  bpi  aight  be  a  reality  by  the  early  seventies  (200  aillion  characters  per  2,400  ft  reel). 
Hence,  there  is  a  lot  of  life  yet  in  aagnetic  tape  systeas  and  it  would  seen  that  it  will  be  hard  to  beat  them 
on  grounds  of  economy,  even  with  aicro-iaage  storage  techniques.  We  any,  therefore,  assume  magnetic  tape  and 
magnetic  tape  units  to  be  around  for  a  long  tine  yet  and  whereas  one  nay  expect  the  storage  capacity  of  the 
aediua  to  Increase,  one  sill  also  require  greater  versatility  in  magnetic  tape  units,  i.e.  to  skip  and  to 
select  specific  file  segments  at  high  speed.  This  is  likely  to  becoae  aore  and  more  important  as  capacity  of 
the  tapes  increases.  Such  facility  in  coabination  with  use  of  discs  might  provide  random  access  facility  at  a 
relatively  low  cost.  As  yet,  randoa  access,  a  facility  essential  for  on-line  enquiry,  can  only  be  provided  by 
storing  the  flle(s)  one  intends  to  use  on  disc  or  drim.  If  the  files  are  sizeable  ones,  this  becomes  an 
expensive  affair,  e.g.  £40O/year /million  characters;  hence  one  tends  to  load  the  disc/drua  only  for  selected 
enquiry  or  retrospective  searching  sessions.  This  obviously  does  not  make  for  easy/ready  access.  Whereas  the 
choice  is  perhaps  easy  when  one  has  to  deal  with  a  relatively  small  file  (up  to  a  few  aillion  characters)  used 
frequently  because  then  one  can  Justify  keeping  it  permanently  on  disc  or  drum,  the  difficulty  arises  with  the 
somewhat  larger  files  which  are  consulted  not  all  that  frequently,  and  unfortunately  such  cases  are  wore 
frequent  than  the  ones  in  which  the  choice  is  a  straightforward  one.  There  is  no  obvious,  simple  and  satis¬ 
factory  solution  to  this  problem  if  one  wants  to  tackle  it  as  an  on-line  operation.  In  our  case,  virtually  all 
file  consultation/search  jobs  are  handled  as  tape  Jobs,  carried  out  according  to  priority  and  requiring  the 
tapes  concerned  to  be  specially  mounted.  Hence,  response  time  is  at  best  13  minutes  and  at  its  worst  a  few 
hours.  The  position  she.. Id  get  easier  as  disc  storage  facilities  becoae  available  at  lower  cost  but  this  is 
not  going  to  make  a  dramatic  improvement  in  the  near  future.  For  some  time  to  come  we  will  have  to  rely  on  the 
Judicious  use  of  tape  storage  and  disc/drua  storage  facilities  separately  as  well  as  in  coabination. 

Another  aspect  of  on-line  storage  arises  froa  the  fact  that  increasingly  large  volumes  of  machine-readable 
literature  are  likely  to  becoae  available  in  the  near  future  as  a  result  of  the  acceptance  of  computer-aided 
editing  and  typesetting  in  the  publishing  world.  At  the  same  tlae,  it  seems  more  than  likely  that  it  will 
becoae  increasingly  difficult  for  the  aediua  sized  libraries  to  maintain  adequate  coverage  of  the  relevant 
literature  in  view  of  increasing  costs;  this  may  well  lead  to  a  rapid  increase  in  the  need  to  borrow  literature. 
It  has  been  suggested^  that  we  should  consider  the  eetabllahment  of  data  banks  in  suitable  national  centres, 
e.g.  in  the  UK  the  National  Lending  Library,  where  machine-readable  current  literature  should  be  collected,  to 
be  accessed  by  local  information  services  v.a  a  digital  network.  Such  centres  would  require  very  large  storage 
facilities,  probably  beyond  the  range  of,  for  example,  the  Datacell  (8  <  4. lO’  char)  Uit  facilities  of  this 
type  have  already  been  developed  experimentally,  e.g.  IBkTs  pho'odlgltal  mass  storage  system*'.  A  aore 
generalised  outline  of  this  type  of  device  is  given  *n  Figure  11.  Buch  facilities  should,  one  hopes,  become 
more  generally  available  during  the  first  half  of  the  I87(ta.  Although  the  storage  coat  per  million  characters 
stored  may  be  expected  to  be  low,  they  will  have  to  be  designed  for  very  large  capacities  if  they  are  to  be 
economical,  hence  their  total  cost  is  still  likely  to  be  high.  One  can  therefore  contemplate  their  use  only 
as  part  of  a  large  coaputer  system,  eg.  our  1108  system  or  a  national  system. 

Their  use  again  presupposes  the  availability  of  a  coaputer  netnorh  as  sell  as  the  capability  to  send  nnd 
receive  locally  the  inforaation  relevant  to  the  operation  of  such  on-line  systems 


6.  MAXIHIRING  TNC  OPTIONS 

At  several  stages  in  the  foregoing  dlseusaioo,  the  need  for  a  system  allowing  various  options  In  dealing 
with  a  problem,  a  search  query,  has  become  apparent.  This  freedom  in  the  selection  of  a  suitable  strategy  is 
required  not  cnly  In  order  to  ensure  an  efficient  match  between  the  processing  requirements  for  a  specific 
problem  and  the  equipment  to  be  used  for  its  solution  but  also  to  achieve  the  moat  effretive  match  as  regards 
user  requirements  and  system  capabilities.  As  indicated  in  an  earlier  paper*',  the  manner  In  <diich  an  intorms- 
tion  storage  and  retrieval  system  interacts  with  its  users  is  perhaps  the  moat  crucial  factor  in  determining 
the  economic  aMrit  of  the  information  service  with  respect  to  the  organisation  served. 

In  the  design  of  am  information  sysiam.  one  should  therefore  pay  particular  attention  to  the  nay  it  allows 
on  the  one  hamd  the  search  strategy  to  be  adapted  to  the  specific  query,  and  on  the  other,  the  user  to  interact 
with  the  tystem. 
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A  f»irly  good  exaaple  of  thiD  typ*-  of  ■pproach  is  our  o»eraiI  systes  for  ch«alcal  structure  handling'  *lth 
its  nany  options  as  regards  search  strategy  and  user  intersctioo.  However,  as  a  aeaningful  discussion  of  this 
systea  is  rather  beyond  the  scope  of  the  present  paper,  it  is  preferable  to  use  a  si^)ler  case  and  illustrate 
the  approach  with  an  outline  of  the  Banner  in  which  we  operate  our  SDl  systea.  As  indicated  above  (under  4), 
must  of  our  current  awareness  requireaents  on  the  site  (perhaps  70'80%)  are  now  covered  br  an  SDI  service  which 
Bakes  use  of  CA  Condensate,]  tapes  supplied  weekly  by  the  CTieaical  Abstracts  Service,  Coluabus.  It  is  a  systea 
run  very  auch  under  direct  control  of  the  user  who  can  adjust  selection  for  any  weekly  search  by  aodifying  his 
search  profile.  The  output  is  retained  on  tape,  a  print-out  of  the  hits  is  supplied  to  the  user  and  screened 
by  hia  to  indicate  articles  of  interest.  This  teforaation  is  used  to  prepare  a  user  file  with  relevant  papers 
relating  to  the  profile  concerned.  To  this  is  also  added  inforaation  obtained  via  scanning  of  journals  avail¬ 
able  in  the  library  but  not  covered  by  the  CA  Condensates  tape  (Pig. 12). 

Hence,  we  have  thus  created  a  aagnetic  tape  file  which  could  act  as  a  substitute  for  the  research  worker’s 
own  private  indexing  systea.  In  order  to  sake  this  really  acceptable,  one  has  to  provide  adequate  access  to 
this  file;  at  present  this  is  likely  to  be  done  via  the  provision,  periodically,  of  a  KWIC  index,  but  at  a 
later  stage  teletypes  will  be  Bade  available  to  give  the  user  the  aeans  to  print-out  froa  his  file  or  add  to 
his  file.  The  economic  incentive  to  this  approach  arises  froa  the  desire  to  reduce  the  aaount  of  tiae  the 
research  worker  has  to  devote  to  current  awareness  activities  and  the  aaintenance  of  a  private  indexing  systea. 

In  this  respect,  there  appears  to  be  a  sound  econoeic  case  for  the  aaintenance  of  user  files  and  the  provision 
of  KWIC  indexes.  The  more  direct  access  via  teletypes,  however,  is  as  yet  aore  difficult  economically  as  well 
as  equipment-wise. 

There  is  a  limiL  as  to  the  number  of  peripheral  devices  one  can  support  with  the  9300  configuration  avail¬ 
able  to  us,  and  we  are  likely  to  reach  it  in  1970  when  3  to  4  teletypes  will  be  attached  to  the  systea.  Further 
moves  will  depend  on  upgrading  of  the  system  to  Univac  9400  capability. 

Access  via  teletypes  is  in  our  case  required  for: 

(a)  Data  collection  (e.g.  screening  data) 

(b)  Pile  consultation 

(c)  Text  editing  and  storage. 

In  the  course  of  this  year  and  1970  the  iapleaentatio-i  of  such  types  of  operation  is  likely  to  be  explored 
on  a  United  and  experiaental  basis.  Similarly  with  regard  to  visual  display  facilities,  we  hope  in  1970  to 
explore  the  feasibility  of  using  this  to  enable  the  gradual  phasing  out  of  the  use  and  aaintenance  of  the  large 
card  indexes  of  research  data  which  are  still  being  kept  operutiocal,  despite  the  fact  that  the  major  proportion 
of  all  the  data  is  now  also  stored  on  aagnetic  tape.  Here  again  oue  has  to  find  an  econoalcally  acceptable 
solution  to  providing  adequate  access  without  absorbing  too  auch  of  the  overall  systems  facilities  in  such  an 
activity. 

As  a  partial  solution  to  this  type  of  problem,  we  have  now  i.istalliid  an  automatic  feature  card  punch  (Pig.  13). 
This  will  enable  us  to  output  data  held  on  our  aagnetic  tape  files  (e.g.  compound  properties)  onto  punch'd 
feature  cards  (Fig. 14)  Output  froa  the  coaputer  is  on  paper  tape  which  acts  as  input  for  the  feature  card 
punch.  It  is  thus  possible  to  prepare  at  a  low  cost  feature  card  ayateaa  tailor-aade  to  specific  user  require- 
aents  The  main  application  is  expected  to  be  in  tbe  area  of  data  aanipulatlon  and  aearches,  e.g.  retrieval 
according  to  specific  property  coabtnattons.  It  will  provide  the  reaearch  worker  with  a  further  means  of  access 
to  data  relevant  to  hia.  this  in  addition  to  the  tape  searuies  run  on  the  coaputer. 


7.  rOHPlTEt  NETWORK 

It  nay  be  clear  froa  the  above  that  in  our  view  a  satisfactory  long  term  development  of  Information  storage 
and  retrieval  systema  requires  the  availability  of  an  effective  computer  network  Fortunately,  the  flbeil 
urganiaatton  in  the  IK  Is.  for  other  reasons,  already  asking  aatiafactery  progreai  in  this  direction  (ref. 
Figure  6)  There  would  appear  to  be  three  aain  aspetta  on  which  one  alght  expect  beoefita  from  the  network 
approach 

(i)  Actual  processing  -  the  feasibility  to  move  the  job  lowmrds  the  lucation/lhe  ievi)  st  which  it  can  be 
awisl  effectively  and  economically  executed 

til)  Mass  storage  -  the  large  capacity  atorage  facilities  referred  to  under  5  ran  only  be  justified  ecca- 
onlcally  if  associated  with  large  centraliaed  installations.  Their  possible  use  in  relntlon  to  the 
storsge  of  published  literature  has  been  dtacuased  to  on  cnrllcr  pngtr' 

(ill)  Dnia  tranamissloo  -  one  would  hope  thnt  the  network  w.ll  enable  n  grtaler  use  to  be  made  of  direct 
data  irMiwisaioo  replacing  at  least  in  part  the  prenent  procedwrea  baaed  on  transport  of  printed 
natter  (or  tapes)  and  the  associated  delays 

Developments  in  this  respect  sre  ss  yet  very  slow,  yet  it  seems  not  unrealistic  to  expert  that  they  will 
figure  prominently  In  the  first  half  of  the  |970s  hMcr,  they  should  be  borne  In  Bind  even  now  when  selecting 
equipment 
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As  an  example  of  the  stepwise  build  up  of  computer  facilities  for  an  information  service,  leading  towards 
their  operation  as  part  of  a  network,  the  development  projected  in  Figure  15  (Ref. 11)  may  be  of  interest.  It 
concerns  the  possible  implementation  of  such  facilities  over  a  period  of  about  10  years  in  a  university  library 
environment. 


8.  CONCLUDING  REMARKS 

Ihe  most  significant  aspect  of  computers  and  their  applications  is  the  speed  with  which  this  field  is 
developing  .ref.  Figure  1).  Hie  indications  are  that  the  impact  of  this  will  become  very  pronounced  in  the 
course  of  the  next  five  years;  it  should  drastically  increase  our  involvement  with  hardware.  The  difficulty  of 
choice,  however,  may  well  ease  as  hardware,  and  particularly  peripheral  devices,  are  likely  to  become  more 
plentiful  and  much  cheaper. 

Perhaps  many  of  our  yet  unfulfilled  wishes,  e.g.  for  cheap  and  versatile  consoles,  ease  of  interfacing,  on¬ 
line  mass  storage  at  a  reasonable  cost,  widespread  data  transmission  facilities,  will  be  met  in  the  next  few 
years,  le  may  expect,  largely  as  a  result  of  LSI  (large  scale  integrated  circuitry)  a  significant  increase  in 
hardware  implementation  of  software  features  and  in  hardware  reliability. 

We  will  have  hardware  in  much  greater  quantity  and  versatility;  the  main  problem  will  be  how  to  integrate 
and  use  it  effectively  and  economically. 
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Growth  of  mech.  energy  relative  to  human  muscle  power  (a) 
Growth  of  computer  capac  ity  relative  to  human  resources  (b) 
For  clerical  work  (acc.  to  Ref.  5) 


Figure  1 


< 

Laboratory 

Subject  field  | 

Woodstock  Agricultural 

Research  Centre 

Chemicals,  in  particular  pesticides,  | 

for  use  in  agricul:  .ral  and  public  ^ 

hMttb  1 

Tunstall  Laboratory 

Toxicology,  environmental  health  1 

aspects  of  Shell  products/processas  1  < 

Milstead  Laboratory 

Chemical  enzymology:  natural  products  | 

of  biological  significance;  micro"  |  .  ' 

biological  research  | 

* 

Total  staff  500  +  | 

Fig. 2  Shell  Research  Laboratories  at  Sittingbourne,  Kent  ^ 


Stage 

Prominent  staff 
activity  type 

Major  type  of  activity 

1 

I 

1956*1962 

Technical  librarian 

Building  up  of  library 
(holdings) 

Building  up  of  subject  filing 
system 

n 

1962*1968 

Information  specialist 

Literature  searches/ surveys 
Research  data  coding  and 
storage 

Current  awareness 

Development  of  computer 
application  in  ISRD 

HE 

1968- 

Information  technologist 

Development  and  maintenance 
of  computer  opeiated 
information  systems  allowing 
maximum  user  interaction 
(SDI,  research  data  dtorage 
and  retrieval) 

Fig- 3  Technical  Information  Services  1956  -  Shell  Research.  Sittingbourne 


Main  developments 

1962*1964 

Preparatory  phase 

Start  with  research  data  coding  (structures) 

IBM  870  tabulation 

IBM  1401  and  Autocoder  use 

Feature  card  system  development 

1964-1966 

First  computer  operated  search  system  operational  (chemical  structures) 
KWIC  indexing 

Variety  of  computer  systems  (processors)  used 

1966-1968 

On-line  computer  use  operational 

SDI  -  Data  acquisition  on  magnetic  tape 

Tape  typewriters  for  text  and  graphic  structure  input 

1968*1970 

Establishment  of  various  access  points  on  site 

Fully  mechanised  feature  card  input 

Start  of  computer  aided  typing 

Start  of  real  on-line  mass  storage 

Rapid  response  query  systems 

Use  of  visual  display 

1970-1972 

Multi-access  system  widely  extended  (perhaps  20-30  access  points) 

I/O  improvements  (CRT,  Rand  tablets  etc.) 

Capture  of  most  site-produced  texts  for  computer  editing/ storage 
Sizeable  on-line  mass  storage  of  literature  information 

Gradual  disappearance  of  most  manual  retrieval  tools 

Fig. 4  Developments  in  mechanised  information  storage,  retrieval  and  dissemination  at  Shell  Research  Limited, 

Sittingbourne 


Location 

1962 

1963 

1964 

1965 

1966 

1967 

1968 

1969 

1970 

1971 

1972 

IBM  870* 

IBM  1460/360-Modet  30 
IBM  1410 

IBM  7094 

IBM  360-Model  50 

Sittingboume 

London 

London 

London 

London 

r" 

> 

Univac  1004 

Univac  1107 

Univac  1108 

Univac  9300 

Sittingboume 

Birmingham 

London 

Sittingboume 

1- 

-¥ 

1401  Autocode 

9300  Assembler/RPG 
Fortran  IV/V 

— ♦ 

1 

Cobol 

Algol 

: 

h-- 

— 

— 

— 

-4 

*  The  IBM  870.  though  not  a  computer,  has  been  included  as  a  forerunner  to  site  computing  facilities 


indicates  minor  use  only 

Fig. 5  Computer  facilities/languages 


Sittingboume 

Laboratories 


London 


Other 

locations 


Fig. 6 


Shell-UK  computer  network  aspi  cts  relevant  to  the  Sittingboume  Laboratories 
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RESEARCH  DATA 

Chemical  structure  storage  and  retrieval  (50,000  compounds) 
Storage  and  retrieval  of  biological  screening  data 
Storage  and  retrieval  of  information  on  spectra 

COMPANY  REPORTS  LITERATURE 
KWIC  indexes 

Tape  search  according  to  profile  in  preparation 
LITERATURE  INFORMATION 

SDI  •  CA  Condensates  tapes,  ca  150  profiles,  1800  terns,  weekly 

Bibliographies 

KWIC  indexes 

Tape  searches  of  patent  literature  (Derwent  records) 

LIBRARY  OPERATIONS 

Control  of  periodical  holdings  and  accounts 
Loan  control 
Meetings  lists 

Fig. 7  Computer  operated  Information  retrieval  activities  at  Shell  Research,  Sittingbourne 


Univac 

9300 

Univac 

1108 

Performance  ratio  for  many 
'compute  bound'  jobs 

1 

50  -70 

Performance  ratio  for  many 
'1/0  bound'  (IR  type)  jobs 

1 

10  -20 

Performance  ratio  as  regards 
capacity  related  to  labour 
effort  (Programming,  operating) 
required 

1 

25 

Hardware  cost  ratio 

1 

25 

It  should  be  stressed  that  the  data  in  the  above  tabulation 
are  very  tentative  only  and  should  be  looked  upon  as  merely 
the  relative  order  of  magnitude. 


Fig. 8  Performance  ratio  for  large  (Univac  1108)  and  small  (Unlvac  9300)  computer  systems 
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1  Capacity  say  10 bits  »  equivalent  to  ca  100.000  vols. 
print. 

2  Would  appear  entirely  feasible  with  present  day  technology: 
various  design  configurations  possible. 

3  Storage  costs  will  be  low,  say  $1  or  less  per  million  bits 
stored  but  only  for  very  large  capacities. 

4  Hence  only  very  large  units  will  be  economical,  cost  say 
minimum  $500,000. 

5  Likely  to  be  mixed  electronic/mechanical.  One  cannot 
visualise  low*co8t  electronic  devices  for  this  purpose, 
at  least  not  in  near  future. 

6  Access  to  random  file  location  wi  II  be  relatively  slow, 
say  of  the  order  of  a  second  but  with  suitable  dynamic 
multi'level  storage  organisation  this  should  be  no  objection 
for  ISRD  use  even  in  real-time  operation. 

7  Read  speeds  should  be  quite  high,  say  %  to  Yz  million 
characters  per  sec. 

8  Likely  to  be  read-only  stores,  but  again  for  archival 
purposes  this  should  be  quite  acceptable. 

9  Available  experimentally  1967;  perhaps  in  more  general 
use  by  early  1970's. 


Fig.  11  Mass  storage  device 


Fig.  12  Coiputer  handling  of  published  literature  using  aagnetic  tape  and  printed  Journal  input 
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Phase 

Computer  budget 

Equipment 

Applications 

I 

ca  £3,500 

Keypunches; 
tape  typewriters: 
off-line  computer 
use 

Loans  system, 
journal  listing, 
journal  subscriptions, 
bibliographies 

n 

ca  £13,000 

OCT  2000  type 
terminal  card  and 
paper  tape  read/ punch: 
on-line  processing 

Building  up  of  files 
in  central  computer 

m 

ca  £27,000 

Library  computer 
on-line  to  large 
university  computer; 
Several  magnetic 
tape  units 

Processing  of  magnetic 
tape  files  in  library. 
Exchange  of  tapes 

IV 

ca  £46,000 

Several  access  points 
to  library  computer. 
Tapes  and  discs, 
multiprogramming 
capability 

Establishing  of  on¬ 
line  enquiry  systems 
and  display 

V 

ca  £72,500 

Graphic  displays. 

On-line  query 

Operation  as  part  of 
large  on-line  network 

Pif .  15  Coaputtr  f«cUltl«»  in  uotvvrnitjr  Ubrnrlac;  ptiMwl  iapl«M«t»tioa 
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Stirsteii’ s  design  for  aechsnlzed  inforaation  services  aust  try  and  aia  at  a  reasonable 
balance  between  the  quality  of  the  service  offered  and  the  operational  econnay  in  rendering 
services.  Considerations  on  input  operations,  subject  control,  structurization  of  the 
vocabulary  used  in  the  systea  and  on  output-foras  are  discussed  in  respect  to  their  effect 
on  quality  and  operational  econoay.  the  experience  gained  during  the  developaent  end  the 
operation  of  the  nuclear  docuaentation  systea  of  the  European  Coaaunity  served  as  basis  for 
the  presentation. 


SOINAIRE 


Dans  la  conception  d’  un  systtee  destind  k  des  services  d'  inforaations  adcanis^s,  on  doit 
s’efforcei  de  rdaliser  un  dquilibre  raisonnable  entre  la  qualitd  du  service  offert  et 
rdconoale  opdratlonnelle  lide  A  la  rdallsation  de  ce  service.  L’ auteur  dtudie  les  opdra- 
tlons  d’entrde,  le  contrdle  des  sujets,  la  structuration  du  vocabulaire  utilisd  dans  le 
aystdae,  et  les  foraea  de  sortie,  A  la  luaidre  de  leur  influence  sur  lx  qualitd  et  I'dconoaie 
opdrationnelle. 

L' auteur  s'est  band,  pour  la  prdparatlon  de  son  exposd,  sur  I’expdrience  acquise  au  cours 
de  la  rdallsation  et  du  fonctlonneaent  du  ayctdse  de  docuaentation  nucldaire  de  la  Coaaunautd 
Buropdenne. 
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THE  INFLUENCE  OF  SYSTEM  DESIGN  ON  SYSTEM  QUALITY  AND  ECONOMY 

Rudolf  Bree 


Introductory  Reanrks 

The  topic,  on  nhich  I  have  been  asked  to  speak  -  that  of  systea  design  nith  reference  to  saall  docuaentation 
centers  -  aakes  oe  feel  slightly  unconfortable,  for  the  staple  reason  that  1  don't  think  that  saall  docuaenta- 
tion  centers  will  have  to  face  such  probleas. 

Skaller  docuaentation  centers  will  noraally  have  very  little  choice  in  this  context  -  if  the  category  "saall" 
docuaentation  center  is  used  in  the  sense  of  a  liaited  staff  serving  a  Halted  nuaber  of  clients. 

This  leads  to  the  conclusion  that  saall  centers  of  this  kind  aust  depend  upon  larger  ones. 

Consequently  "systea  design"  is  soaething  they  aight  never  have  to  cope  with  and  this  prevents  thea  rather 
effectively  froa  coaaitting  errors  in  this  field.  They  can  leave  this  happily  to  the  larger  centers.  However, 
cooperating  with  larger  centers  they  are  tied  to  the  aistakes  these  coMit. 

Therefore,  systea  design  aust  be  of  Interest  to  saaller  centers.  They  should  understand  the  conditions  upon 
which  certain  decisions  have  been  based.  Being  a  saaller  center  aeans  also  being  auch  closer  to  the  individual 
user.  This  puts  thea  right  between  these  users  and  the  systea  designers. 

I  could  stop  here  by  stating  that  anything  aore  said  is  beside  the  point.  But  it  aight  still  be  interesting 
to  discuss  errors  in  systea  design,  regardless  of  the  size  of  the  center.  My  reaarks  night  be  biased.  They  are 
based  upon  specific  experience  with  operation  of  the  EURATUM  systea  for  storage  and  retrieval  of  nuclear  inforaa- 
tion.  which  was  developed  rather  early  on  and  without  auch  help  froai  experience  of  third  parties.  Therefore  aaple 
rooa  was  left  for  the  nethod  of  trial  and  error. 

■)ich  naln  features  did  we  have  in  aind  when  «  sapped  out  that  ‘hystea’*^  fe  witheJ  to  assiat  the  potential 
client  to  solve  his  particular  problea  by  giving  hia  access  to  a  aaxlnua  of  the  available  inforaatioo.  Aat  he 
was  looking  for  he  should  get  as  fast  as  possible,  at  least  before  his  aind  got  stale  on  that  problea  and 
before  he  decided  to  abandon  his  search  for  available  infoneation  and  atart  experinentlng  all  on  his  on.  shat* 
ever  the  expenditure  in  aoney  and  tlae  sight  be. 

Fhrtheraore  we  wished  to  supply  Inforaatlon  to  the  client  in  a  fora  and  a  quantity  he  could  digest,  and  in  a 
say  which  would  help  hie  without  burdening  bin.  So.  shat  we  were  striving  for  in  our  ayatea  deaign  was  both 
useful  and  usable  quality  -  within  the  teras  of  a  justifiable  budget  for  developaeoi  as  well  as  for  operational 
ecao<*’y.  He  felt  that  without  quality  we  would  lose  the  users  and  without  operational  rccaoay  we  would  risk 
losing  our  sponsors 

The  average  user  does  not  sees  to  be  interested  either  tn  the  degree  of  sophistication  of  the  systea  or  in 
the  aethods  by  which  operational  econoay  is  obtained.  Viat  h  '  cares  shout  is  being  served  in  a  speedy  and 
reliable  say  and  in  a  fora  which  aakes  it  easy  for  hia  to  digest  the  offered  asterisl. 

Ttying  to  aect  these  staple  sounding  requiraaants  tn  systea  design  is  not  so  easy  A  few  of  the  design 
aspects  we  can  apeak  about  froa  our  own  experience  are: 

|.  Input  baaed  on  titles,  abatracis  or  coaplete  testa. 

}.  Subject  control  by  free  or  tor  controlled  vocabuinry  •  or  by  a  hierarchical  ayatea: 

).  Structurization  of  a  controlled  vocabulary;  u  it  possible  snd  it  belpfuP 

A.  Should  the  retrieval  organization  be  bnned  upon  Boolean  algebra  or  on  seightingv 

S.  Output  in  the  lorn  of  title  listings,  of  abstracts  or  of  coaplete  textsv 


I.  INPUT  BASES  BN  TITLES,  IBSTBACTS  BS  UMPLETE  TESTS 

ihality  of  retrieval  and  operational  cconoaor  are  both  greatly  inllotaced  by  the  fora  of  Input  chosen 

1.1  R>r  acceae  to  a  docwaent.  knowledge  of  its  tide  ae«M  to  be  indiapcnaable  Basiag  (ofnt  solely  on  titles 
is  inpoaaible  because  they  are  generally  inanfficient  for  snbject  rcpreaentatlon.  and  therefore  lor  subject 
control.  It  night  be  necessary  to  store  the  titles  in  the  context  of  (he  conplete  descriptive  catslagulng  of 
the  docnntnt. 
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1.2  Abstracts  are  superior  tc  titles,  insofar  as  their  quality  is  satisfactory,  fir  know  that  in  our  field 
about  8%  of  the  abstracts  are  badly  written  and  that  a  further  7%  of  them  could  bear  improvement.  As  a  basis 
for  retrieval  a  kind  of  abstract  is  required  which  refers  to  all  the  important  concepts  contained  in  a 
document. 

Using  abstracts  for  input  does  not  necessarily  mean  that  their  texts  have  to  be  incorporated  in  the  storage, 
the  limitation  of  the  number  of  acceptable  characters  and  diacritical  signs  would  still,  in  most  of  the 
existing  computers,  require  a  considerable  amount  of  editing  of  the  text,  which  can  be  very  expensive, 
especially  if  texts  in  several  languages  are  to  be  used. 

1.3  Full  document  text  storage  in  digital  form  does  not  seem  to  be  an  economical  proposition  at  the  present 
time.  It  is  regrettable  that  computer-controlled  image  storage  is  not  yet  in  existence.  Compared  with  indexing 
from  abstracts,  indexing  from  complete  texts  has  both  advantages  and  disadvantages.  It  would  compensate  for  the 
about  15%  bad  abstracts.  On  the  other  hand,  indexing  from  complete  texts  alone  is  time  consuming  and  invites 
incorporation  of  too  many  peripheral  aspects  of  a  document  in  the  Indexing.  This  would  result  in  retrieval  of 
non-significant  documents.  As  a  general  rule,  a  workable  compromise  seems  to  consist  in  basing  indexing  on 
abstracts,  keeping  the  documents  at  hand  for  reference  and  to  supplement  the  indexing  if  necessary. 

It  would  be  an  error  to  base  indexing  on  titles  alone,  because  of  the  resulting  low  quality  of  such  indexing. 


2.  SUBJECT  CONTROL  BV  FREE  OR  BV  CONTROLLED  VOCABULARY 

Use  of  a  controlled  vocabulary  -  the  thesaurus  approach  -  necessitates  initially  a  great  many  decisions  on 
the  selection  of  the  terms.  Later  on  during  indexing  and  retrieval  it  requires  intimate  knowledge  of  the 
chosen  concept.  The  terms  of  the  controlled  vocabulary  look  like  terms  of  the  free,  that  is  the  natural, 
language  -  which  is  deceptive.  In  fact,  in  some  cases  many  of  the  terms  used  cover  only  part  of  what  the  term 
implies  in  natural  language.  Hence  the  need  for  profound  knowledge  of  the  vocabulary  and  consistent  application 
during  indexing  and  retrieval. 

in  these  circumstances  the  idea  of  doing  away  with  controlled  vocabulary  and  instead  using  freely  the  sig¬ 
nificant  terms  as  used  by  the  author  of  a  paper  and  readily  available  in  the  text  is  enticing.  Well,  in  prac¬ 
tice  a  "free  vocabulary"  is  not  so  free.  This  is  because  one  has  to  apply  much  sophistication  in  storing  the 
terms  to  avoid  an  enormous  fixed  storage  in  the  computer  and  to  facilitate  the  matching  process  during  the 
retrieval  operation.  To  take  care  of  the  different  grammatical  forms  of  each  term,  truncation  can  be  used. 
Homonyms  and  synonyms  create  tricky  problems.  Practically  all  of  the  numerous  terms  and  forms  of  the  free 
language  have  to  be  oduced  again  inside  the  computer  to  a  smaller  number  of  terms  -  we’re  back  to  a  con¬ 
trolled  vocabulary  again.  But  at  the  free  language  end  the  computer  must  accept  an  almost  unlimited  number  of 
terms  which  must  be  made  recognizable.  Considering  that  the  average  author’s  discipline  in  applying  his 
terminology  leaves  something  to  be  desired  and  that  things  are  complicated  further  when  several  languages  are 
to  be  used,  one  might  soon  find  that  the  use  of  free  language  is  costly  and  hardly  improves  precision  of 
retrieval. 

It  is  true  that  indexing  based  upon  a  controlled  vocabulary  requires  a  high  degree  of  discernment,  but  for 
each  document  only  once  for  all.  Precise  focusing  in  retrieval  then  becomes  possible.  So  it  might  be  prefer¬ 
able  to  use  a  controlled  vocabulary,  on  the  condition  that  certain  rules  are  respected  during  its  development: 
synonyms  and  homonyms  must  be  discarded:  no  term  can  have  more  than  one  meaning. 

During  the  development  of  a  controlled  vocabulary,  it  should  be  kept  in  mind  that  its  purpose  is  not  so  much 
to  facilitate  indexing,  but  to  effect  precision  in  retrieval.  However,  in  the  initial  phase  retrieval  usually 
cannot  be  tested  in  a  conclusive  way.  During  this  part  of  the  development  it  is  recommended  to  follow  closely 
the  frequency  of  assignment  of  each  term.  Too  frequently  used  terms,  especially  those  of  too  general  a  charac¬ 
ter.  lose  any  significsnce  lor  retrieval  because  of  their  frequency.  They  must  therefore  be  replaced  by  more 
specific  terms.  The  EURATOM  Thesaurus  introduced  therefore  a  category  of  terms  deslgii-ced  “forbidden  terras’’  - 
which  are  listed,  but  only  with  reference  to  other  terms. 

Hierarchical  systems  hr .e  always  been  dear  to  many  people.  Their  structure,  built  around  the  generic  context 
of  terms,  seems  to  offer  a  very  acceptable  means  of  putting  order  in  conceptions  and  ideas.  We  cannot  judge 
from  broade”  experience  whether  or  not  there  is  a  reel  chance  left  for  profitable  use  of  such  systems  in  mech¬ 
anised  storage  and  retrieval  systems. 

Compared  to  the  two  other  methods,  coordinate  indexing  has  established  its  feasibility  even  in  large  systems  - 
for  retrieval  quality  as  well  as  for  operational  economy.  For  smaller  centers  with  specialised  collections  it 
is  even  relatively  easily  transferred  to  manual  retrieval,  using  peek-n-boo  cards. 

3.  STRUCTURIZATION  WITHIN  A  CONTROLLED  VOCABULARY 

A  system  of  coordinate  Indexing  based  upon  controlled  vocabulary  might  seem  to  be  incompatible  with  struc¬ 
turization.  We  foiuid,  however,  that  this  can  be  even  combined  in  a  very  attractive  way.  The  machine  dictionary 
containing  all  th  thesaurus  terms  can  be  used  for  geueric  term  grouping. 
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Khen  tlie  EURATOH  Thesaurus  was  ccapile*),  «3  used  the  subject  heii!:>*ngs  fros  NSA  and  arranged  them  -  in  the 
beginning,  t"  h'come  cler'  ■:yc  ki^ds  as  to  their  ccMantic  context  and  their  scope  -  in  the  form  of  two- 
dimensional  graphs  Then  we  transfotned  the  subject  ceadi4gr-  into  unlvocal  keywords,  eliminating  all  homonyms 
a.nd  synonyms.  Hain^aining  the  initiirt  graphic  display,  we  went  one  step  further  and  a/ranged  in  clusters, 
around  the  keywords,  terms  of  higher  specificity.  In  the  eid  we  had  charU-ii  the  whole  nuclear  field,  depicting 
visually  the  relation  between  the  terms,  delimiting  the  meanings  of  the  keywords  of  hiphr-r  generic  character  by 
the  more  specific  terms  around  them.  We  avoided  in  ttiis  way  having  to  compile  a  slossary  and  soon  we  learned 
how  profitable  and  helpful  this  kind  of  display  is  fur  effecting  sufficient  cjuAistency  in  decentralised 
indexing  Later  on,  for  formulating  retrieval  ouestiona,  ce  fo’ind  It  as  usefui  ts  for  sndexin.'i,  especially 
after  we  indicated  for  each  term  the  freqaency  of  its  assigccent,  because  tble  enabled  us  to  calculate  the 
p.-obahie  number  of  answers  to  be  expected  during  fvtrisvgl. 

This  visual  display  has  great  appeal.  Supplementing,  tp:  It  does,  toe  indispensable  aipheoetical  lioting  of 
terms,  it  is  in  many  instances  su]  rior  as  a  working  tool. 

Later  o.t  we  introduced  this  generic  structure  Into  the  machine  system  Itself,  starting  very  successfuiiy  an 
automatic  generic  posting  operation.  This  permitted  to  establish  the  very  simple  indexing  rule:  “u^e  the  most 
specific  index  term".  The  computer  adds  automatically  all  the  generic  terms.  In  this  way  we  virtually  double 
the  number  of  terms  assigned,  facilitating  retrieval  at  any  generic  level 

In  our  opinion  this  kind  of  structurization  and  the  automatic  generic  posting  atiuid  facilitate  the  work  of 
smaller  information  centers  too. 


i.  USE  OF  bOOLEAN  ALGEURA.  OR  WEIGHTING 

The  application  of  Booleun  algebra  to  retrieval  in  a  system  based  on  coordinate  indexing  does  not  raise  many 
problems.  Its  efficiency  has  been  proved.  Weighting  at  terms  is  an  aitentative  to  Bocleac  operators  in 
retrieval*.  In  some  cases  a  query  is  more  easily  formulated  in  Uoclean  algebra  and  in  others  weighting. 

The  selective  effect  of  Booleaii  algebra  is  considerable.  In  a  system  which  eBj'-vces  a  million  entries,  three 
keywords,  each  of  which  has  been  used  about  ten  thousand  times,  can  be  combined  in  Roolean  algebra  in  such  a 
way  as  to  produce  only  about  ten  references. 

However,  we  have  learned  in  the  meatitlce  to  combine  very  usefully  both  methods,  securing  firstly  satisfactory 
recall  by  way  of  a  Boolean  term  ccmbination  and  subjecting  the  result  to  a  secoud  aochino  routine,  then  applying 
weighting,  achieving  in  this  way  a  ranking  procedure  idiich  helps  to  eliminate  noise. 


5.  OllTPUT  IN  THE  FORM  OF  TITLE- BIBLIOGRAPHIES,  OF  ABSTRACTS  CR  OF 
COMPLETE  TEXTS 

Decisions  on  output  form  influence  organization  and  opeietiosal  econofjy  considerably.  Here  we  have  the 
psychologically  important  interface  between  the  system  and  the  iiidividual.  The  more  or  less  elaborate  presen¬ 
tation  of  document  data  can  be  justified  finally  only  in  terms  of  its  actual  usefulness  to  ivs  clients.  The 
user  must  feel  that  he  is  being  helped  and  not  burdened,  when  using  the  systen. 

This  has  many  consequences,  most  of  which  seoa  to  be  so  obvious  thot  it  hardly  seems  worth  mentioning  them. 

One  absolute  condition  of  a  system  is  that  it  should  be  adaptable  to  the  purpos.,iS  of  the  individual  user. 

The  number  of  references  which  will  be  acceptable  varies  greati.v,  depending  on  whether  the  user  is  writing  a 
thesis,  or  a  handbook,  or  on  whether  he  is  posing  his  question  with  a  view  to  applying  for  a  patent,  or  again 
on  whether  he  wants  to  bring  himself  up  to  date  on  recent  developments  in  a  given  field.  We  can  take  it  for 
granted  that  this  adaptation  can  be  effected  during  retrieval. 

So,  how  can  the  client  best  be  served:  by  a  title  list,  a  set  of  abstracts  or  by  complete  document  texts? 

The  quickest  (and  not  too  expensive)  way  would  seem  to  br  a  machine  printout  of  bibliugrapbiceT  data  - 
supplemented,  on  demand,  by  the  printout  of  the  Indexing  terms.  However,  the  user  cannot  read  at  once  all  the 
documents  referred  to  him  nor  does  he  usually  want  to.  He  wants  to  start  with  the  most  promising  ones.  How 
can  he  select  them  most  easily? 

A  machine  printout  of  bibliographical  data  will  permit  such  selection  only  rarely,  so  he  would  have  either 
to  select  at  random  or  to  pass  the  total  list  to  his  librarian  asking  for  all  documents  listed  neither  method 
being  really  satisfactory. 

Passing  on  to  the  user  the  results  in  the  form  of  abstracts  would  obviously  facilitate  selection  and  ranking 
most  effectively.  However,  this  is  a  method  which  seems  to  be  rather  expensive  when  performed  by  the  computer, 
not  only  because  of  the  considerable  tape  length  which  results  from  storing  text  in  digital  form,  but  because  a 
large  proportion  of  the  abstracts  has  to  be  edited  carefully  before  input  in  view  of  printout  limitations.  As 


*  Weighting  of  retrieval  terms  in  order  to  obtain  an  output  ranked  by  probable  relevancy  must  not  be  cenfused  with  the 
(seldom  used)  weighting  of  index  terms,  the  purpose  of  which  is  to  show  the  relative  Importance  of  individual  concepts 
in  a  document. 
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an  alternative  the  printed  abstrarts  can  be  scored,  in  reproduced  fora  if  necessary,  in  a  large  file.  This  is 
fine  for  readability.  However  fron  the  point  of  view  of  operational  economy  it  leaves  much  to  be  desired.  The 
organization  of  such  a  file  supposes  the  availability  of  printed  abstracts.  Improvements  might  be  possible  by 
transfer  to  microforms,  but  really  satisfactory  methods  of  fast  access  to  large  files  are  lacking,  even  for 
microforms. 

To  furnish  the  user  full  texts  -  which  obviously  would  be  possible  either  in  full  size,  reduced  size  or 
microcopy,  would  be  even  more  expensive  and  would  suppose  a  considerable  organization.  Moreover,  a  large  part 
of  the  effort  involved  in  doing  so  would  be  evidently  wasted,  because  documents  retrieved  by  the  system  but 
discarded  by  the  user  would  have  been  produced  unnedassarily. 

Consequently  the  relatively  most  useful  form  for  output  seems  to  be  abstracts,  because  it  really  allows  the 
user  the  indispensable  facility  to  choose  between  the  documents.  The  higher  cost,  compared  to  title  printout, 
is  balanced  by  the  gains  in  user  ease  and  that  is,  finally,  in  user  acceptance  of  the  service  offered. 

Where  input  and  output  are  concerned  numerous  decisions  must  be  made,  which  can  have  far  reaching  conse¬ 
quences,  either  for  the  quality  of  retrieval,  operational  economy  or  the  usefulness  of  the  service  to  the 
user.  I  have  only  mentioned  a  few  as  a  reminder  of  the  complexity  of  the  choices  facing  the  system  designer. 

To  go  back  on  earlier  decisions  on  the  form  of  input  or  output  is  always  possible  at  a  later  stage  and  would 
only  involve  material  losses.  Errors  in  design  of  the  subject  control  could  have  grave  consequences  from 
which  smaller  centers  would  suffer  as  much  as  larger  ones. 


PROBLEMS  OP  INPUTTING  DATA  FROM  OTHER  SYSTEMS 


Jack  E.  Brown 


llie  National  Science  Library  of  Canada  serves  ss  the  focal  point  of  a  national  scientific  and  technical 
information  network.  Working  in  close  co-operation  with  other  libraries  and  information  centres,  it  serves  as 
an  information  transferral  agency  and  endeavours  to  provide  scientists,  engineers  and  industrialists  with 
immediate  access  to  publications  and  information  required  in  their  day  to  day  work. 

The  NSL  employs  a  variety  of  computerized  techniques  to  facilitate  the  handling  of  information  and  has  since 
1966  operated  an  SSI  program  in  the  Ottawa  area.  In  January  1969  the  program  was  redesigned  and  expanded  to 
provide  a  National  SOI  service  which  has  been  fully  operational  since  February  1969.  A  variety  of  data  bases, 
then  on  the  market,  were  tested  and  evaluated  to  determine  the  minimum  number  of  tape  services  which  might  be 
exploited  to  obtain  maximum  coverage  of  the  S  &  T  literature. 

In  order  to  overcome  the  problems  created  by  incompatibility  of  tape  services,  a  standard  file  format,  based 
on  the  MARC  II  format  was  developed,  to  which  various  data  bases  can  be  converted  with  relative  ease.  To  date 
220  librarians,  scientists  and  information  specialists,  from  all  parts  of  Canada,  have  been  trained  in  weekly 
seminars  conducted  by  the  NSL,  to  serve  as  search  editors  and  provide  direct  assistance  in  setting  up  interest 
profiles.  A  Profile  Design  Manual”  was  prepared  and  distributed  to  search  editors  and  to  all  subscribers  to 
the  service. 

At  present,  subscribers  to  the  CAN/SDI  service  have  access  to  three  tape  services:  Chemical  Titles,  Chemical 
Abstract  Condensates  and  ISI  Source  tapes.  INSPEC  tapes  and  others  will  be  added  as  time,  staff  and  funds 
permit.  All  journals  covered  by  these  tapes  are  held  by  the  NSL  and  photocopies  of  cited  papers  can  be  obtained 
from  the  NSL,  if  the  journal  is  not  available  locally.  Subscribers  receive  computer  print-out  of  pertinent 
citations,  weekly  or  every  two  weeks,  depending  on  the  tape  service  selected.  References  are  printed  separately 
on  a  two-part  slip,  one  part  of  which  is  used  as  a  response  form  to  provide  feedback  and  permit  updating  and 
improving  of  interest  profiles. 

Note:  A  detailed  account  of  the  CAN/SOI  project  will  appear  in  •  'TIational  Science  Library  of  Canada  SDI 
Program”  Special  Libraries,  Vol.60,  Oct.  1969. 
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PROFILE  -  NUMBER 


INSERT  YOUR  ADDRESS  LABEL  IN  THIS  BLOCK 


SHEET-  NUMBER 


Dr.  S.G.  Calvert 
Division  of  Biosciences 
Room  3143 
100  Sussex  Drive 
Ottawa,  Ontario 


BTAt#  VOtfH  S8AIW4  14  BOW*,  ADO  »W0  RBrOMlWMI  OB  PA^BRS  POOMSHBO 

»Y  OR  A>  OOiltEARUE  WQRKIKS  fN  YOW  FIELD,  (PLEASE  TYPE  SR  PRIMl}  t 


In  order  to  support  ongoing  research,  I  request  references  dealing  with  the 


effect  of  Z-deoxy-glucose  and  2-deoxy-galactose  on  animals  or  humans  - 


especially,  has  anyone  administered  either  of  the  above  and  what  happened. 


I  am  interested  in  their  possible  action  on  an  antibiotic,  and  their  toxi¬ 


city,  particularly  on  humans.  The  2 -deoxy-glucose  is  usually  cited  as 


2-deoxy-D-glucose  or  -d-glucose,  and  both  are  also  spelled  as  'desoxy’. 


The  galactose  form  has  been  cited  also  as  fucose ,  I  am  interested  in  the 


isomers.  3-deoxy-glucose  and  3-deoxy-galactose. 


REFERENCES 


1)  J  Brown 


Effects  of  2-deoxy-glucose  on  carbohydrate  metabolism.  Review  of  the 


literature  and  studies  in  the  rat. 


Metabolism  Vol.ll,  p. 1098-1112,  Oct.  1962. 


2)  C  Lutwak-Mann 


Effect  of  2-deoxy-D-glucose  on  the  rabbit  blastocyst. 


J.  Reprod.  Fertil.  10,  133-S,  Aug.  196S. 
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SUMMARV 


Criteria  to  be  considered  before  introducing  coaputerized  inforaation  retrieval  service(8) 
are  analyzed.  Special  attention  is  devoted  to  decision  taking  in  switching  to  an  auto- 
■ated  systea  and  to  the  training  of  the  personnel  including  directors  and  senior  staff. 


SOMAIRE 


L‘ auteur  analyse  les  critires  qu’il  iaporte  d‘ exaainer  avant  d'introduire  un  ordinateur 
dans  un  service  de  recherche  d'  informations.  II  consacre  une  attention  toute  particulidre 
A  la  decision  de  passer  A  un  arstAae  autoaatis^,  et  A  la  formation  du  personnel,  y  coapris 
le  directeur  et  les  cadres  sup^rieurs. 


RETRAINING  OF  PERSONNEL  TO  FIT  INTO  AUTORATED  SVSTEH 


J.H.Mnpp 


ItaiB  is  an  extreaely  broad  field,  and  I  aa  afraid  «y  report  will  only  atHsarize  a  few  evident  facts  ahicli 
you  all  know. 

To  deal  with  this  subject,  I  have  adopted  the  folluwinc  layout: 

-  Criteria  to  be  considered  before  you  decide  whether  or  not  to  introduce  a  coaputer  in  your  service. 

-  list  of  existing  personnel  in  the  light  of  the  alas  pursued. 

-  Re-training. 

If  you  have  decided  to  use  a  coaputer,  this  aeans  that,  after  seriously  analyzing  a  certain  nuaber  of  factors, 
you  have  decided  to  create  a  new  docuaentation  research  systea. 

1.  Let  us  review  those  criteria  which,  in  fact,  indirectly  define  your  work  and  the  personnel  to  use: 

1. 1  Area  covered  by  the  systea,  with  indication  of  the  degree  of  depth  for  each  branch  of  this  area,  and  of 
the  period  covered  since  the  origin. 

1.2  Review  of  services  covered  by  the  systea,  with  indication  of  the  extent  of  the  field,  of  the  degree  of 
coaplexity  or  iaproveaent  reached  in  the  research  process,  and  list  of  oints  of  potential  custoaers. 

1.3  Possibilities  of  extending  the  systea  to  other  fields,  with  indication  of  possible  ease  of  eootdlnatlon 
with  slailar  services  already  ensured  in  initially  covered  fields. 

1.4  Sickness  of  systea,  with  indication  of  the  speed  at  ehlch  questions  on  a  given  docuant  ran  be  atswered, 
reckoning  frca  the  date  of  publication  of  this  dociaent. 

1.3  Cost  of  explottatton  of  the  systea  with  study  of  cost  of: 

-  data  recording 

-  data  processing  and  output 

•  use  of  data  provided  by  the  systea. 

Apart  froa  the  factors  listed  above,  other  technical  criteria  have  to  be  considered,  such  as: 

(I)  Cerd-tndex  ittt  /ortor 

-  nwriier  of  articles  in  the  card-index 

•  acquisition  rate  {increase) 

-  obsolescence  rate 

-  coaplexity  of  field  covered 

(S)  AciivUy  /actor 

-  frequency  of  questions  per  day,  per  user,  etc. 

-  necessary  speed  of  answer 

(5)  fVaetralton  Factor 

-  depth  of  penetration  isle  given  field  (Indeslng  depth)  of  docuaents  Included  in  the  inforaatlon  systea 

-  inpleasntation  of  anehine  possibilities  sufficient  for  ensuring  tbe  shove  penetration 

(4)  Coolrol  factor 

(3)  QUaJtty  factor 

-  reliability  of  docuaent  atalysis 

-  reliahitity  of  docutntary  research  operations  tnd.  consequcally.  noise  level 
(g)  Cipontthi  lily  factor 

-  possibility  of  ndding  nco  notions  to  the  systea 

-  ability  of  the  systaa  to  adivt  itself  to  topics  dealing  uith  other  fields 

•  possibility  of  briagiag  up  to  tete  aaiy  copies  of  the  overall  card- lades  la  varioaa  places,  at  a 
reasonable  coat 

-  possibility  of  deallag  uith  a  great  variety  of  qaentloaa  at  a  reaaoaable  cost 
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(7)  Cost  factors 

-  cost  of  analysis 

-  cost,  of  codification 

-  cost  of  reseaich 

-  cost  of  use  of  machine  research  output 

-  amortization  of  costs  in  the  various  uses 

(8)  Physical  factor 

-  forDi(s)  of  output 

-  adaptability  to  a  variety  of  machines. 

Therefore,  the  above  criteria  should  be  carefully  considered  when  evaluating  a  given  system  in  the  light  of 
a  need  or  of  a  set  of  given  needs.  The  results  of  such  a  study  will  certainly  lead  you  to  conclude  whether  or 
not  a  computer  can  solve  your  problems. 

An  excellent  American  study: 

“Study  of  mechanization  in  DOD  Libraries  and  Information  Centers  -  Technical  Report  AD  640100” 

presents  the  same  conclusions  in  a  different  form.  Another  specialist,  Mr  Frank  Allen,  has  expressed  identical 
opinions. 

2.  The  aim  of  a  documentation  center  (I  am  not  speaking  of  a  data  analysis  center)  is  to  provide  rapidly,  in 

an  easily  assimilable  form,  the  documentation  indispensable  to  the  user.  This  assimilable  form  broadly  presents 
two  aspects: 

-  a  rapid  description  of  received  documents 

-  a  quick  answe.  to  a  given  question,  generally  in  the  form  of  bibliographic  references, 

that  is  to  say  publication  of  abstract  journals  and  bibliographic  lists.  I  am  leaving  aside  the  reproduction 
aspect,  which  does  not  fall  within  the  scope  of  my  report. 

I  shall  not  mention  either  the  advantages  of  the  computer  over  manual  systems:  increased  easiness  in  the 
production  of  abstract  journals,  reduced  retrieval  time  for  bibliographies,  transformation  of  document  loan 
channels,  reduced  time,  therefore  reduced  personnel,  additional  products  like,  for  instance,  selective 
diffusion  of  information. 

To  put  these  advantages  in  concrete  form,  an  enthusiastic  staff,  bent  on  improving  itself  as  well  as  its 
working  methods,  is  indispensable;  it  is  therefore  necessary  to  re-train  your  collaborators.  But  what  are  the 
categories  of  tiocumentalists  who  need  re-training? 

3.  Good  re-training  must  be  adapated  to  the  documentallst’s  intellectual  as  well  as  hierarchic  level,  and  to 
his  specific  work. 

We  shall  then  consider  the  following  categories: 

3.1  “Directors"  and  senior  staff  members  who  advise  them  as  regards  the  decision  to  introduce  a  computer  in 
the  service. 

3.2  Executives,  engineers  or  scientists  qualified  in  documentation.  One  can  make  a  distinction  between: 

-  those  to  be  assigned  to  the  computer  (analysts,  programmers,  etc. ) 

-  those  who,  without  being  assigned  to  the  computer,  are  in  direct  relationship  with  it  (analysts,  report 
writers,  lexicographers,  etc. ) 

-  those  whose  work  is  indirectly  related  to  the  computer,  or  those  likely  to  have  their  assignment  changed. 

3.3  Documentalists,  assistant-documental ists,  librarians,  printers,  typists,  etc. 

-  those  to  b<.  assigned  to  the  computer  as:  operators,  console  operators,  card-punchers,  etc. 

-  personnel  likely  to  be  assigned  to  the  computer  (replacements,  break-down  service,  etc. ) 


4.  WHO  MDSr  BE  RE-TRAINED,  AND  WHEN  MUST  RE-TRAINING  TAKE  PLACE 

4.1  To  start  with,  we  have  mentioned  directors  and  senior  staff  members  who  will  use  the  services  of  the  com¬ 
puter.  Tbeir  knowledge  of  the  computer  must  be  8.Ynthetic  rather  than  analytic.  Lectijres  or  dourses  laying 
particular  stress  on  the  possibilities  offered  by  the  material  must  be  organized  for  them.  Their  attention 
must  be  drawn  to  the  direct  part  which  they  must  play  in  order  to  der'''e  the  best  possible  benefit  from  a 
computer  equipped  service. 

Such  lectures  or  courses  should  take  place  prior  to  the  very  decision  of  introducing  a  computer,  so  that  this 
decision  may  be  made  advisedly;  in  particular,  studies  on  cost  efficiency  must  be  conducted  in  order  to  determine 
the  various  operations,  or  documentation  phases,  which  can  be  carried  out  automatically,  and  efficiently  from 
the  cost  viewpoint. 
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Such  preliminary  re-tralning  of  this  catetjory  of  personnel  is  indispensable  to  adapt  the  computer,  and 
especially  its  softeare,  to  the  needs  of  the  service,  and  to  determine  the  order  in  which  documentation  must  be 
automatized.  In  other  words,  these  lectures  moat  give  emphasis  to  the  elements  which  determine  the  choice  of 
the  mate;  ial  and  the  organization  of  data  procesa.tng;  therefore,  it  is  necessary  to  have  some  knowledge  of  the 
material  and  of  the  |■rugrafflming  systems.  This  re  -training  phase  must  be  complemented  by  application  courses, 
wtien  the  corre.sponding  application  is  started,  in  order  that  the  adjustment  of  the  system  may  be  controlled 
efficiently  and.  possibly  its  operation  lmprovf>d. 

4.2  Secondly,  we  have  mentioned  documental ist-eiigineers  and  executives,  in  particular  those  to  be  a.ssigned  to 
the  computer  as  analysts,  programmers.  oi‘  to  be  directly  responsible  for  automatic  data  processing  services. 

There  again,  very  complete  re-training  must  take  place  prior  to  the  installation  of  the  computer,  in  order 
that  such  personnel  may  use  it  immediately  and  efficiently  (computer  hours  are  heavy  on  a  dccumentation  budget). 

Personnel  directly  responsible  for  automatic  data  processing  services  must  be  re-trained  in  order  to  acquire 
a  precise  technical  knirwledge  of  the  material  ^^lich  they  will  have  to  manage,  but  do  not  need  to  reach  the  level 
of  detailed  knowledge  which  will  be  that  of  specialized  personnel.  Usually,  senior  administrative  personnel 
are  quite  qualified  to  occupy  such  positions. 

In  view  jf  their  turn  of  mind,  specialists  used  for  document  analysis  and  indexing  are  quite  apt  to  become 
analysts.  These  will  be  in  charge  of  accurately  defining  and  developing  the  organization  planned,  then  of  re¬ 
stating  problems  in  the  light  of  the  processi.ng  means  made  available  to  them,  and  even,  possibly,  of  defining 
these  means. 

As  regards  programming,  which  is  both  a  technique  and  an  art,  specialists  of  indexing  analysis  are  also,  in 
view  of  their  training,  apt  to  be  rapidly  re- trained  to  be  application  programmers.  In  other  words,  they 
operate  and  control  the  computer  in  advance  (they  must  know  in  advance  what  must  be  done),  or  else,  they  speak 
to  the  machine  in  a  particular  language,  in  order  that  this  machine  may  carry  out  a  given  task  in  the  least 
possible  time. 

Among  this  category  of  personnel,  one  should  also  consider  analysts  and  documental ist-engineers  who  stay  in 
their  position  and  continue  their  work,  and  whose  activity  is  mainly  devoted  to  feeding  the  computer  indirectly, 
according  to  a  certain  process,  and,  especially,  to  establishing  a  glossary  and  keeping  it  up  to  date.  Ibis 
glossary  will  be  the  basis  of  the  whole  system. 

The  glossary,  which  is  coded,  is  however  established  and  developed  by  documental ist-engineers  (or  specialists 
from  the  outside)  who  must  also  have  some  notions  about  the  computer  and  what  can  be  obtained  from  it.  It  is 
they  who  define  and  state  with  accuracy  the  questions  to  be  put  to  the  machine,  in  particular  for  bibliographic 
research,  selective  diffusion  of  information,  etc. 

Consequently,  such  personnel  must  also  be  re-trained 

Besides,  it  is  always  useful  to  have  versatile  personnel  available;  therefore,  from  the  same  category  of 
specialists  one  should  select  those  likely  to  assist,  or  even  replace  analysts  and  programmers  if  need  be. 

These  will  also  have  to  be  re-trained,  but  only  after  the  computer  has  been  installed. 

4.3  Thirdly,  you  need  operators,  console  operators,  card  punchers,  etc.  who  must  know  the  general  console 
handling  operations  (starting,  initial  loading,  resumption  of  work,  stopping,  disconnection  of  computer)  as  well 
as  the  precise  handling  operations  for  peripheral  units  (mounting  of  bands  and  discs,  use  of  printers,  readers 
and  punchers,  etc. ) 

This  offers  assistant  documentalists,  librarians,  printers,  etc  a  new  career  opportunity  since,  starting 
from  the  position  of  console  operators,  they  may  become  later  on  programmers  and  therefore  get  better  salaries, 
etc. 

This  also  applies  to  typists  who,  by  becoming  operators,  increase  their  salaries  from  20%  to  25%  (in  Prance, 
at  least). 

As  regards  this  overall  category  of  personnel,  re-training,  of  course,  must  take  place  prior  to  computer 
installation. 

Nevertheless,  it  should  be  pointed  out  that  such  personnel  must  take  an  ability  test  prior  to  being  re-trained, 
and,  besides,  that  only  persons  under  40  should  be  considered  for  such  positions. 

These  tests  and  the  age  limit  restriction  will  certainly  reduce  the  number  of  pre-selected  candidates,  but, 
on  the  other  hand,  have  the  disadvantage  of  compelling  you  to  recruit  outside. 

Now,  it  is  preferable  for  any  personnel  in  charge  of  automatization  to  be  also  familiar  with  documentation 
problems.  Mutual  comprehension  of  everyone’s  respective  tasks  leads  to  better  results. 

5.  Complete  re-training  should  include: 


courses  and  lectures 
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-  constructive  courses 

-  practical  assignments  and  exercises. 

5. 1  Hie  Directorial  Staff,  that  is  to  say  the  Directorate  and  senior  staff  members,  must  attend  lectures  or 
lecture  series  which  last  approximately  30  days,  distributed  of  course  over  several  months.  The  subjects 
covered  are  broadly  as  follows; 

-  general  information  on  conventional  material  (punched  cards,  for  instance) 

-  general  information  on  hardware,  software  and  exploitation 

-  study  cases 

-  role  and  responsibility  of  leading  staff  members  in  front  of  the  computer 

-  relations  of  the  computer  service  within  the  company 

-  the  processing  unit 

-  external  memories 

-  exploitation  aystems 

-  remote  processing,  etc. 

Based  on  the  results  of  the  criteria  mentioned  at  the  beginning  of  this  paper,  this  personnel  will  be  in  a 
position  to  give  instructions  on  the  use  of  the  ccaputer,  particularly  in  certain  fields  like: 

-  documentation  management 

-  abstract  Journals 

-  indexes 

-  bibliographies 

'  selective  diffusion  of  Information 

-  automatic  type  setting 

-  and  especially,  which  orientation  to  follow  in  the  field  of  eouipment  to  meet  the  needs  of  documentation 
while  keeping  in  mind  the  cost  efficiency  of  the  various  documentation  operations,  that  is  to  say  the 
economic  management  of  the  system  once  installed. 

5.2  As  for  the  second  category  of  personnel,  that  is  to  say  future  analysts  and  programmers,  courses  will  be 
rore  complete  and  detailed  than  for  the  first  category.  They  will  include,  in  particular: 

Basic  data  on  computers: 

-  General  logic  of  computers  (coding-memory) 

-  Main  input-output  units 

-  Notions  on  organizational  charts 

-  Languages  and  principles  of  exploitation,  whatever  be  the  configuration  of  the  machine  used. 

Programming: 

-  Technical  training  for  direct  work  on  the  machine 

-  Practical  exercises. 

Installation  and  starting: 

-  General  principles  on  the  development  of  a  data  processing  service: 

-  Presentation  cf  material  to  be  used: 

-  Memory,  channels,  inputs  and  outputs,  organization  of  card-indexes,  etc. 

-  Presentation  and  comparison  of  languages 

-  Presentation  and  comparison  of  exploitation  systems. 

-  General  principles  governing  the  implementation  of  a  computer: 

-  General  analysis  methodology 

-  Development  of  analysis  and  programming  data. 

The  average  time  allocated  to  re-training  is: 

-  For  analysts:  3  months  of  pure  analysis 

3  months  of  progrtunming  and  language  for  training  proper 
13  days  for  annual  re-training 

-  For  already  certificated  analysts  (that  is  to  say,  analysts  having  attended  the  specialized  courses  or 
lecture  series  organized,  as  far  as  we  are  concerned,  by  the  ‘Ministry  of  Finance"  (examination  in  two 
parts:  control  test  plus  oral  exam),  3  months  of  training,  plus  15  days  of  annual  re-training  are 
necessary. 

3.3  As  far  as  the  third  category  of  personnel  is  concerned,  appropriate  courses  must  be  attended  before  and 
during  the  installation  of  the  material.  Courses  last  less  time  but  it  is  only  through  practical  exercises 
that  adequate  personnel  can  be  selected.  Additional  information  courses  will  complement  these  lecture  series. 
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5.4  Plnaliy,  psychological  action  should  especially  be  taken  before  and  during  the  installation  of  the  material. 
Unavoidably,  you  will  note  a  certain  uneasiness  within  your  service,  but  there  again  it  is  indispensable  to  act 
with  strictness,  however  with  tact.  It  is  difficult  for  personnel  to  understand  that  the  computer,  far  from 
taking  work  away  from  them,  gives  them  more  to  do;  this  new  work  is  different,  maybe  more  automatic,  but  not 
deprived  of  interest.  As  a  matter  of  fact,  computers  demand  a  strict  discipline  in  the  laying  out  and  develop¬ 
ment  of  work,  and  do  not  admit  of  any  errors. 

6.  As  a  conclusion,  certain  evident  f^ts  could  be  summed  up' 

-  Consic’t  T-  and  analyze  your  activity  thoroughly  before  introducing  your  computer,  as  the  re-training  which 
your  P'i'sonnel  will  have  to  go  through  will  mean  expenses  and  loss  of  work  (for  which  you  will  certainly 
make  up  later  on). 

-  Rc- training  must  take  place  prior  to  the  introduction  of  the  machine, 

-  Careful  selection  of  the  personnel  to  be  re-trained  is  a  vital  necessity  for  a  firm.  Certain  tests  are 
excellent  to  orient  your  choice,  and  you  will  be  surprised  at  the  results  obtained  by  certain  candidates. 

-  Your  attention  is  especially  drawn  toward  the  re-training  of  the  leading  staff  of  your  service. 
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SUMMARY 


In  traditional  documentation  systems  the  user  perform'^  a  search  in  alphabetical  subject 
indexes  by  looking  up  single-term  entries.  For  computerized  documentation  systems  using 
coordinate  indexing  and  retrieval,  precise  query  formulations  are  essential.  There  are 
different  ways  of  getting  the  user  to  make  his  query  more  precise.  Users’  comments  are 
indispensable  for  evaluating  the  efficiency  of  the  system.  A  feedback  formsheet  is 
presented,  and  an  example  of  feedback  given.  In  preparing  an  SOI  profile,  a  retrospective 
search  should  first  be  performed,  which  the  user  must  evaluate. 

In  view  of  eliminating  the  documentalist  as  an  intermediary  between  the  user  and  the 
system,  it  can  hardly  be  expected  that  the  user  will.  Just  to  handle  a  few  queries  per 
year,  learn  all  the  retrieval  rules  the  documentalist  must  bear  in  mind.  On  the  contrary, 
the  system  would  have  to  be  developed  in  a  way  which  enables  the  applicant  to  make  direct 
use  of  it. 


SOMMAIRE 


Dans  les  syst^mes  de  documentation  traditionnels,  I’utilisateur  effectue  sa  recherche 
en  se  basant  sur  les  mots-vedette  des  index-mati6res.  Dans  les  syst^mes  de  documentation 
4  indexation  coordonn^e,  basds  sur  I’emploi  d’un  ordinateur,  il  est  essential  que  les 
questions  soient  formuldes  de  fa^on  prdcise.  Les  commentaires  des  utilisateurs  sont 
indispensables  pour  juger  de  I'efficseitd  du  systdme.  L’ auteur  prdsente  le  formulaire 
utilisd  pour  consigner  les  commentaires  (feedback),  et  donne  un  exemple  de  ce  "feedback”. 
Pour  dtablir  un  profil  d'  Intdrfit  en  vue  de  la  distribution  sdlcctive  des  informations 
(DSI),  11  faut  tout  d’abord  effectuer  une  recherche  rdtrospective,  sur  laquelle  I’utl- 
lisateur  devra  donner  son  avis  circonstancid. 

^■nd  on  veut  dllminer  le  documental iste  en  tant  qu*  intermddiaire  entre  1’ utilisateur 
et  le  systdme,  on  ne  peut  gudre  s’attendre  A  ce  que  I’utilisateur,  rien  que  pour  trailer 
quelques  questions  par  an,  entreprenne  I’dtude  des  rdgles  de  la  recherche  documentaire 
en  ordinateur.  Au  contraire,  le  aystdme  devra  dvoiuer  de  telle  fa^on  que  le  deaandeur 
soil  capable  de  s’en  servir  directement. 
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RE-EDUCATING  USERS  TO  AUTOMATED  SYSTEMS 
Carlo  VerniBb 


A  scientist  or  technician  Bust  expend  sose  effort  in  order  to  get  hold  of  such  scientific  publications  as  he 
needs  for  his  work.  This  effort  is  divided  into  two  operational  steps:  firstly  he  aust  decide  which  publica¬ 
tions  he  needs,  and  secondly  he  aust  procure  the  publications.  Procureacnt  is  easily  effected  through  a  libra¬ 
ry,  and  this  aspect  of  the  problea  will  not  be  considered  here  in  any  detail.  Instead,  our  interest  will  be 

directed  toward  the  effort  expended  by  the  scientist  to  deteraine  which  publications  he  needs. 

In  traditional  docuaentation  systeas  a  scientist  will  have  to  search  through  alphabetical  indexes  and 
library  card  files  grouped  according  to  subject,  author,  etc.,  and  he  will  have  to  scan  suitable  abstract 
journals.  To  begin  his  search,  he  will  need  a  heading  by  which  to  enter  the  subject  indexes.  If  he  does  not 

iaaediately  find  an  answer  to  his  problea  he  will  try  again,  under  soae  other  entry.  After  checking  a  few  of 

the  references  found,  other  entries  will,  as  a  rule,  come  to  his  Bind,  and  he  will  start  searching  anew.  Such 
a  aanual  literature  search  uses  single -tera  entries  and  applies  what  I  would  call  “instant  feedback".  The 
scientist  may  start  with  only  a  vague  idea  of  his  problea;  instant  feedback  will  add  precision  to  his  query. 

In  most  of  the  modern  computerized  documentation  systeas  with  coordinate  indexing  and  retrieval,  a  docuaen- 
talist  acts  as  an  intermediary  between  the  scientist  and  the  system  of  which  the  ducuaentalist  has  to  be  con¬ 
sidered  a  part.  This  fact  makes  it  necessary  for  the  docuaentalist  to  have  a  clear  idea  of  the  query,  so  that 
knowing  the  scientist’s  problem,  he  can  add  precision  to  the  query. 

In  our  experience  with  the  Euratoa  Nuclear  Documentation  System  it  is  Just  this  accurate  and  clear  dellaita- 
tion  of  the  query  which  is  the  most  difficult  problea.  In  our  request  forasheet  for  literature  searches  (Fig. 1) 
which  the  applicant  is  asked  to  use.  we  therefore  give  hia  the  following  hint; 

“Define  the  subject  with  enough  precision,  so  that  a  docuaentalist  specialized  in  your  field  but  not  necessarily 
acquainted  with  your  particular  subject  can  thoroughly  understand  the  question,  and  also  recognize  what  would 
not  he  of  interest  to  you." 

But  this  advice  has  proved  insufficient  to  change  the  habits  of  the  scientists  using  our  systea.  Host  of  them 
still  put,  their  queries  in  the  traditional  single-term  fora.  Me  have  therefore  had  recourse  to  more  stringent 
measires.  These  measures  find  their  expression  in  a  soaewhat  aggressive  guideline  the  user  will  find  on  the 
back  of  the  request  formsheet  (Fig. 2).  There  it  is  said: 

TELL  US  »HAT  YOU  WANT  TO  KNOW  - 

SO  WE  SHALL  TELL  YOU  WHAT  IS  KNOWN  ABOUT  THAT. 

But  do  not  fling  your  query  at  our  heads  like  a  brick! 

Do  not  ask  for  “radioact Ive  strontlua  coapounds"  when  you  can  ask  more  precisely: 

“Which  radioactive  strontiua  coapounds  will  in  reactor  operation  be  generated  within  the  fuel  eleaents 
froa  the  strontlua  produced  in  uraniua  fission  by  chemical  reactions  with  other  components  of  the 

fuel  eloaents  (e.g.  carbon,  oxygen  in  UC  or  00,).  and  so  on .  The  query  is  of  Interest 

because  decontaaination  measures  in  case  of  damage  to  a  fuel  eleaent  will  be  dependent  on  the 
kind  of  the  strontiua  compounds  escaping." 

Thus,  your  query  should  auch  less  b*’  slailar  *q  a  title  than  to  a  short  abstract." 

Therefore  please  do  not  name  us  air  isolated  concept  -  radioactive  strontli’a  compounds  -  for  which  you  alght 
yourself  feci  Inclined  to  look  in  tuU;  lists  or  subject  Indexes.  Concerning  radioactive  strontium  compounds 
alone  we  have  got  aore  than  'J.OOO  literature  quotations  stared  in  the  aeaory  of  the  Computer,  aich  a  mass 
would  overburden  you.  Our  Computer  is  in  need  of  a  meaningful  combination  of  significant  concepts,  which  we 
shall  elaborate  froa  the  query  formulated  by  you;  thl.s  will  be  the  only  way  for  you  to  obtain  the  abstracts  you 
are  really  looking  for 

One  thing  is  certain: 

The  aore  accurately  you  word  your  query,  the  more  precisely  you  will  know  what  you  want  to  know, 
and  the  better  you  will  learn  what  our  Oxaputer  knows  abtmt  it. 

These  rather  brusque  directions  have  already  had  som»?  effect  It  has  become  auch  less  frequent  for  us  to 
have  to  ask  the  user  to  word  his  query  clearly 
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Another  experience  is  that  a  user  finds  it  easier  to  reveal  details  and  define  his  needs  more  exactly  on  the 
telephone  than  in  a  letter. 

There  arc  only  a  few  remarks  I  would  make  on  the  second  point:  getting  user  reactions  to,  and  acceptance  of, 
changes  in  the  form  and  appearance  of  system  output. 

Often,  the  user  will  consider  the  results  of  a  computerized  documentation  system,  as  a  complement  to  the 
results  of  the  traditional  system  to  which  he  is  accustomed.  He  does  not  have  to  decide  straight  off  that  he 
will  restrict  himself  to  the  traditional  or  to  the  computerized  system.  If,  after  having  had  recourse  to  the 
computerized  system  the  user  feels  that  it  offers  him  results  comparable  to  the  best  results  he  could  obtain 
from  the  traditional  system,  he  will  come  to  rely  more  and  more  on  the  computerized  system  which  demands  less 
effort  on  his  part  to  get  access  to  the  desired  information. 

The  rapidity  with  which  be  abandons  the  traditional  for  the  computerized  system  will  depend  on  the  relevance 
of  the  items  supplied  to  him,  on  the  completeness  of  the  results  of  the  search,  and  on  the  speed  of  the  service. 
The  form  of  presentation  will  have  a  minor  but  not  a  negligible  influence.  Abstracts,  copied  or  in  computer- 
printed  form,  are  preferred;  computer  printouts  of  bibliographical  references  are  acceptable;  microforms  are 
not  looked  on  with  favor.  If  computer  printouts  are  supplied,  those  which  distinguish  between  lower  case  and 
upper  case  letters  are  preferred. 

Tr>  enable  us  to  evaluate  the  efficiency  of  the  system  and  to  get  advice  on  increasing  its  functional  value, 
users’  comments  are  Invaluable.  In  the  experimental  stage  of  the  Euratom  system,  queries  are  processed  on  the 
sole  condition  that  the  user  supplies  feedback  on  the  results  of  our  search  on  a  feedback  formsheet  as  follows 
(Pig. 3); 

I  do  not  require  any  supplementary  references. 

I  should  like  to  receive  further  references  published  after  19. . 

I  missed  references  concerning:  . 

I  do  not  require  any  references  concerning:  . 

I  have  modified  my  question  as  follows:  . 

In  addition,  he  is  asked  to  give  the  numbers  of  the  references  supplied  and  to  say  wiiether  they  were: 

(a)  |)ertinent  but  already  known; 

(b)  pertinent  and  new; 

(I.)  not  just  pertinent  but  useful; 

(d)  outside  subject  limits  and  so  of  no  interest. 

Furthermore,  he  is  asked  to  quote  bibliographical  data  of  pertinent  references  not  supplied  to  him. 

•hen  re-educating  scientists  in  the  use  of  automated  systems  is  conuldered,  this  effort  of  supplying  feedback 
will  also  count. 

Let  me  give  you  an  example  (Fig. 4):  A  user  wanted  information  on  pneumatic  devices  for  control  purposes. 

He  wished  to  have  a  general  view  on  the  aubject. 

A  telephone  call  to  the  user  brought  to  light  the  fact  that  he  was  not  very  familiar  with  the  subject  and 
that  he  wished  to  see  how  far  electronic  control  could  be  replaced  by  pneumatic  control. 

•e  agreed  that  a  start  ahould  be  made  with  a  preliminary  search  and  that  the  query  should  be  subsequently 
clarified  by  feedback. 

A  simple  retrieval  query  (Fig.  S)  was  formulated  with  the  keyword  FNIUIIATICS,  snd  the  keywords  CQNTWg.  or 
(XWTML  SYSTIMB  or  MMOTE  (.JNna 

One  hundred  of  the  references  retrieved  sere  checked  for  relevance  sad  TO  were  sent  to  the  user. 

In  his  comments  (Fig. 6)  the  user  stated  that  be  wished  to  modify  bis  query  to  "fluid  anplifiers".  and  that 
the  two  references  NS  30  08443  sad  ST  63  39183  sere  pertinent  ind  new  to  him.  whereas  the  remaining  88  refer¬ 
ences.  although  not  entirely  pertinent,  were  useful  (I  believe,  in  clarifying  his  requirements  in  his  own  nind 
at  least). 

A  new  retrieval  query  (Fig.T)  was  then  formulated  with  the  keyword  AmFIttS  and  the  keywords  FLUIDS  or 
FLUID  FLOt.  Ibis  query  resulted  in  several  additional  pertinent  references.  Of  course,  it  does  not  always 
become  apparent  that  after  feedback  the  retrieval  query  needs  to  be  formulated  again,  using  a  completely  new 
set  of  keywords. 

So  far  my  rsMrkt  have  mainly  referred  to  retrospective  literatu!  "arches.  The  tine  has  non  come  to  say  a 
few  words  on  Selective  Dissemination  of  Isforaatian  (SOI),  that  ia  per.  lical  information  on  recent  publications 
dealing  with  a  .rtaln  subject.  SDl  is  intended  to  replace  the  traditional  browaing  through  primary  and 
secondary  journals.  Of  sn  SOI  service  it  will  also  be  true  that  Ue  speed  with  which  the  traditional  method  is 
replaced  depends  on  the  quality  of  the  service. 
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For  preparing  an  SDI  profile,  I  should  like  to  reconuend  the  following  procedure  which  has  been  adopted  b; 
EuratoD. 

At  first,  each  SDI  search  is  handled  like  a  retrospective  search,  but,  if  the  retrieved  references  are  too 
nuaerous,  it  is  restricted  to  docuaents  published  within  the  past  few  years.  The  user  is  requested  to  supply 
feedback.  As  long  as  feedback  is  not  received,  no  SDI  profile  is  prepared. 

When  feedback  has  been  received,  the  query  is  refonnilated,  in  order  to  reduce  aachine  output  as  far  as 
possible  to  such  references  as  the  user  found  to  be  relevant,  ensuring  that  no  relevant  itea  is  lost,  of  course. 

Feedback  is  indispensable  because  the  user  could  have  in  the  aeantiM  changed,  or  only  aade  up  his  aind. 

This  is  illustrated  by  the  exaaple  on  pneuaatic  control.  But  there  is  another  reason  for  reforaulating  the 
query,  i.e.  the  experience  the  docuaentalist  will  have  gained  in  checking  the  relevance  of  the  docuaents 
retrieved  in  the  retrospective  search. 

a 

I  should  like  to  give  you  an  exaapie:  We  received  the  query  Tontrol  of  operation  of  power  reactors  by 
coaputers”.  We  first  forBulated(Fig. 8) 

(CONTROL  CONTROL  STSTRHS  +  HONITDRING) 

•  (OPHIATION  +  STABTW  +  SHUTDOWN) 

•  (POWBt  PLANTS  *  REACTORS) 

•  (COHHJTERS  ^  DIGITAL  STSTfllS  +  ANALOG  STSTBIS) 

+  aeans  “Vr" 

*  aeans  “luid*’ 

The  priaary  retrieval  teras  (X)NTROL,  OPOIATION,  POWBl  PLANTS,  and  COMVIERS  were  suppleaented  by  near-aynooya 
teras  which  could  have  been  used  instead  in  indexing. 

With  a  systea  voluae  of  900,000  docuaents  this  query  resulted  in  180  docuaents  r -trleved,  40  of  wbieb  proved 
to  be  relevant;  consequently,  relevance  ratio  was  calculated  as  22%. 

■len  checking  the  relevance  of  the  docuaents  retrieved,  the  docuaentalist  detected  (1)  that  the  teras 
DIGITAL  STSTOiS  and  ANALOG  STSTEKS  contributed  no  relevant  Iteas  and  (2)  that  aany  references  sere  retrieved 
in  which  the  coaputer  was  used  for  calculations  (indicated  by  the  keyword  NWRICALS),  or  for  siaulatlag  the 
behavior  of  reactors.  Fbrtheraore,  he  realised  that  the  indexers  aight  have  used  only  one  ten  of  the  first 
two  lines  of  the  query  foraulatlon  to  index  a  relevant  doctwent.  ‘Dontrol  of  power  reactors  by  coaputers" 
could  as  well  be  a  title  for  a  relevant  docuaent  as  ‘Operation  of  reactors  by  coaputers".  As  a  consequence,  the 
first  two  lines  were  coabined,  which  results  in  the  new  query  foraulatlon  (Fig.  9): 

(CONTROL  ^  CONTROL  STSTBB  «  MONITORING  ^  OPERATION  *  STARTW  t  aRTIDOWN) 

’  (POWER  PLANTS  «  REACTORS) 

*  COMPUTERS 

(NUMERICALS  <  SIMUUTORS) 


•-  aeans  "aBd  not" 

This  query  yielded  880  docuaents.  480  of  which  proved  to  be  relevant  •  a  relevance  ratio  of  79%  Ihua.  by 
reforaulating  the  query,  the  nuaber  of  pertinent  iteas  retrieved  increased  by  a  factor  of  12 

The  average  relevance  ratio  for  retrospective  searches  turns  out  to  be  aore  than  40%  in  the  Furatoa  ^stea. 
Making  use  of  the  docuaentalist* a  experience  in  screening  the  reauiia  of  the  retrospective  search,  and  taking 
the  user's  feedback  into  account,  it  was  possible  to  obtain  an  average  relevance  ratio  of  about  80%  for  IDI 
searches.  By  the  nay,  I  do  not  know  of  any  large  docuaentatlon  systea  in  operation  in  which  such  a  high  rele¬ 
vance  ratio  is  being  achieved. 

The  user  is  expected  to  accept  a  certain  awount  of  itoise".  Say.  20%  of  irrelevant  docuMots  night  be 
acceptable  The  percentage  could  even  be  higher  for  snail  shipnents.  becssae  the  user's  workload  for  cbecklag 
relevancy  would  be  a*all. 

■e  have  got  one-and-a-bal f  years'  experience  with  now  about  900  SDI  profiles  applied  to  ■onihly  batches  of 
10.000  docuaents,  and  resulting  in  an  average  of  10  abstract  copies  to  be  sent  to  each  user  without  aaty  further 
checking  of  relevancy  With  focr  or  five  exceptions,  all  users  have  accepted  this  standard  of  service  So  far 
there  has  been  virtually  no  change  of  profiles  But  several  users  cancelled  their  profiles  and  desired  new 
ones  to  be  established  to  neet  chaagea  ia  their  fields  of  activity. 
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In  this  diasria  (Pig.  lO)  the  user’s  effort  In  applying  to  s  trr’iti^nal  docuaentatlon  systea,  with  its 
alphabetical  subject  indexes,  library  card  files  and  abstract  joun  ■xls.  is  compared  with  his  effort  in  availing 
himself  of  a  computerized  documentution  sytitem  with  coordinate  indexing  and  retrieval.  In  the  first  case,  the 
effort  consists  in  searching  through  alphabetical  indexes  via  single-term  entries  (headings),  with  application 
of  instant  feedback  to  make  the  (piery  more  precise.  In  the  second  case,  the  effort  conLlu.s  in  formulating  a 
precise  query,  cooentinc  on  results,  and  rephrasing  the  query  if  necessary:  feedback  is  thus  considerably 
dilayea  as  compared  with  the  traditional  method.  For  the  computerized  documentation  system,  the  documentalist 
must  complement  the  user’s  effort  by  interpretation  and  formulation  of  the  query,  by  logical  coordination  of 
search  terms,  by  checking  the  rexilts,  and  by  reformulation  of  the  query  if  necessary. 

The  fact  th,it  the  user’s  effort  will  decrease  as  he  changes  over  from  the  traditional  to  the  computerized 
system  will  at  first  please  his,  but  his  enthus’asm  will  be  somewhat  coded  by  the  need  to  adjust  to  a  new 
technique.  Even  the  hi^er  yield  of  useful  documents  obtained  by  the  computerized  system  will  r.^t  deceive  him 
as  to  the  fact  that  he  must  rely  upon  the  system  documentalist  as  an  intermediary,  and  that  he  can»iot  start  a 
search  poasessing  only  a  vague  Idea  of  the  problem,  fou  may  think  that  obliging  the  user  to  express  his  needs 
more  eicirly  will  In  any  case  be  to  his  profit,  that  he  will  understand  his  own  problem  better.  But  1'  this  is 
not  possible  (beesuse  he  is  not  clear  in  his  owr.  mind  about  his  problem)  the  slngle-teru-entry  method  with 
instant  feedback  would  offer  some  advantage,  /ind  who  can  say  whether  the  latter  method  is  not  better  suited  to 
the  humrn  way  uf  thinking? 

Ibe  problem  is  bow  to  do  away  with  the  systea  documentalist  this  could  be  done  by  shifting  ‘he  borderline 
between  the  user’s  and  tte  documentalist' s  efforts  to  the  right,  or  hy  shifting  the  borderline  between  the 
documentalist  lud  the  system  to  the  left,  or  even  by  shlfwieg  beth  borderline;  towards  eKh  other. 

"Te  had  some  disappointing  experiences  in  setting  tiie  user  interested  in  query  formulation.  For  such  a  simple 
query  aa  ’’Isotope  eurienment  for  uranium  235  by  ultracentrtfuges”  (Fig.  11).  one  user  looked  up  the  Guratoa 
‘theaaunis  and  proposed  the  foraulaticai: 

’SOldPBS  *  BNRICMUWT  •  Ut/MIM  235  *  ULTRACanWFUGfiS 

Kit  in  indexei  svlgning  URANIUH  235  .should  never  txd  the  term  ISOTOPES.  Bireover,  according  to  a  specific 
Indexing  rule,  the  keyword  ISOTOPE  StPABATlON  wuiuld  have  to  be  used.  The  correct  formulation  should  have  been; 

ISOTKTE  SEPARATION  •  (ORANIOH  235  +  ISOTOPES)  •  ULTRACHflRIFtKilB 

The  user's  formulation  mould  have  yielded  virtually  no  answer  -  and  this  is  a  simplt  exawle  only.  It  can 
hardly  be  expected  that  a  user  will,  just  to  process  a  few  queries  e  year,  learn  all  the  indexing  and  retrieval 
rules  the  documeutaliat  has  to  bear  in  mind. 

To  try  snd  make  the  system  documentalist  superfluous,  we  must,  in  my  cpiaioo.  shift  the  right  bo-derline 
coaslderL  ly  to  the  left,  and  the  left  borderline  only  a  little  to  the  right,  aifting  the  right  borderline  to 
the  left  means,  first  of  all,  direct  access  *o  tbe  c-mputer.  Direct  access  is  being  used  in  severtl  experiments! 
documsmtation  systems.  But,  as  far  ss  I  can  seo,  and  as  far  as  performance  is  concerned,  it  will  sot  be 
poaatble  to  replace  the  documental let  by  direct  access  alooe. 

»•  can  count  on  the  ability  of  the  user  to  judge  between  pertinent  and  Irrelevant  documamts.  we  need 

is  a  system  iblch  will  present  to  the  user  -  by  way  of  direct  access  -  ducusenlt  or  sbatr  cts  of  documents  on 
which  hw  can  base  his  judgment  eonceralns  relevance,  which  is  then  directly  fed  back  into  the  system. 

Lmt  M  sketch  rcuchly  the  iactraetlon  bctwwmo  user  and  ayatam.  without  the  dc-iiumentaliat  aa  intermedUry; 

I.  The  saer  iseda  his  query  in  oaturai  laaguage.  via  a  console  into  the  coaiputer 

3.  It.y  qaery  Is  iadexed  antomalical ly.  i.e.  heyworda  are  derived  from  it. 

3.  The  system  preaemta  theme  keywords,  aa  well  ea  semantically  relaicd  keywords,  via  a  leluviaion  screen,  to 
Ue  user  who  choomes  the  most  emt^repriate  and  ocerdinates  Uem  by  the  logical  op-iatioo  ’umd”  and  *h>r". 

4.  The  ayatam  then  indiemtea  the  aumber  of  emmara  that  would  be  retrieved  be  the  proposed  f.ursuUti«n.  tod 
the  aaer  is  given  the  peaaibility  to  reduce  the  number  of  anaecrt  by  adding  a  keyword  (with  "and")  repre- 
aaatimg  am  addilloMl  coaditiun.  or  to  increase  tbe  aumber  o!  anawtrs  by  leaving  aeay  less  significant 
keywords. 

5.  Bibllotraphlcal  data  or  abatracta  of  tbe  document  retrieved  are  abown  up  on  the  screee 

d.  the  naer  checks  these  documimta  for  relevance  antil  be  has  obtaised.  any  4  clearly  pertinent  end  4 
chamcteristicalLy  irrelevamt  doenments 

7.  the  reference  numbers  of  lie  clear  tiits’’  amd  of  the  characteristic  'moiae"  are  fed  oech  lato  the  aysint 

t.  la  andi  a  relevance  feedbneh  procedure  the  r«anlning  retrieved  naaueru  on  the  query  are  ranked  in  the 
order  of  their  perttnemee  prohabilily.  A  document  sill  have  high  pertinence  probahtlily  when  its  indexing 
is  aintlnr  to  that  of  documents  already  fonnd  tc  be  i>ertiatnt. 

9  The  uacr  chc'dta  the  ranked  doenmenta  for  relevance,  on  tbe  screen,  if  the  maaber  ia  liaited.  on  a  computer 
prlatoat  evpplisd  In  him.  if  the  nember  is  higher 
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Diis  procodure  can  run  through  a  nunber  of  loops.  In  addition,  the  query  can  be  autoaatically  loosened  by 
adding  seaantically  s.iailar  terns  as  alternatives  to  the  original  query  tine.  I  should  like  to  rewind  you  of 
the  terns  STARTUP  and  SHUTDOWN,  used  as  alternatives  to  OPBIATION  in  our  exenple.  The  query  can  also  be 
‘tightened’’  autonatically  by  foinulating  it  out  of  the  keywords  Initially  used  to  index  the  pertinent  docunents. 

By  tightening  and  loosening  the  query  fomulation,  always  adjusting  it  by  checking  for  relevance,  and  by 
using  the  relevance  feedback  procedure,  it  should  be  possible  to  focus  the  query  fomulation  on  the  pertinent 
docunents  contained  in  the  systew.  This  is  a  coaplex  procedure,  but  essential  parts  of  it  have  already  been 
tested,  and  there  is  reasonable  hope  that  one  day  not  only  the  docunentalist  will  be  aade  superfluous  as  an 
interaediary  between  the  user  and  the  systea  but  also  it  will  be  sade  possible  for  the  user  to  start  bis  search 
with  only  a  vague  idea  of  his  problea  and  to  add  precision  to  his  query  by  instant  feedback 
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COMMISSION  OF  THE  EUROPEAN  COMMUNITIES 

Dirtctorate  Central  "Disttmination  of  Informotion* 

C  I  D 


Documontation 


RS- 


Oata; 


LITERATURE  SEARCH 

REQUEST 


1.  FIRM  OR  ORGANIZATION: 

Raquester's  noma' 

Address  for  correspondence: 

Telephone/ telex  No.:  Extension  No.; 

2.  SUBJECT  OF  THE  SEARCH: 

(Define  the  subject  with  enough  precision  so  thot  o  documentolist  speciolized  in  your  field  but 
not  necessarily  acquainted  with  your  particular  subject  con  thoroughly  understand  the  question, 
and  also  recognize  what  would  not  be  of  interest  to  you).  To  help  us  pinpoint  your  problem,  please 
r.;antion  o  few  relevant  documents  and,  if  possible,  supply  o  copy  of  their  first  page. 


3.  PURPOSE  OF  THE  SEARCH; 

a)  I  would  like  to  have  a  general  view  on  the  subject  of  my  request  (to  become  ac¬ 
quainted  with  a  new  field  or  on  urgent  technical  problem). 

b)  I  would  like  to  complete  my  own  bibliography  in  my  specialized  field  or  check 
its  completeness. 

I  already  know _ relevont  publications. 

The  search  should  be  limited  to  documents  published  ofter _ 

For  this  period,  I  expect  to  receive _ references. 

c)  Can  you  quote  mo  ony  documents  published  prior  to _ and 

possibly  impairing  the  novelty  of  the  inventive  idea  exposed  under  Item  2? 

4.  ANY  OTHER  REMARKS; 


□ 

□ 


5.  PUos*  Mnd  ont  copy  of  tvory  obctroct  portinont  to  my  quory.  I  om  oworo  of  tho  foct  thet  I  moy  u«o 
such  copies  only  for  porsonol  ends  ond  not  divvipo  thorn  (honding  over  of  copies  to  stoff  members  working 
with  my  own  employer  is  not  deemed  to  be  divulgotion),  ond  thot  the  outhor  is  entitled  to  o  foir  romunerotinn 
if  the  reproduction  serves  commerciol  purposes. 


(signoturs) 


Figure  I 
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Tell  us  whot  you  want  to  know  - 
so  we  shall  tell  you  whot  is  known  about  that 


But  (!o  not  fling  your  query  of  our  heads  like  o  brick  ! 


Dot  not  ask  for  <  rod/ooctive  sUontium  compounds  >, 


when  you  con  ask  more  precisely : 

<  Which  roc/iooctivo  sircnfium  compounds  will  in  roactor  operation  he  generated  within  the  fuef 
efements  from  the  strontium  produced  in  uranium  fission  hy  chemicaf  reactions  with  other 
components  of  the  fuef  efements  (e.g.  carbon,  oxygon  in  UC  or  UO,),  end  by  which  reaction 
mechanisms  will  such  strontium  compounds  originate  ?  ft  is  said  hat  strontium  oxide  has  so  far 
been  traced  A  pertinent  publication,  however,  is  not  known  to  us.  The  query  is  of  interest  because 
decontamination  measures  in  case  of  damage  to  a  fuel  element  will  be  dependent  on  the  kind  of  the 
strontium  compounds  escaping*. 


Thus,  your  query  should  much  less  be  similor  to  o  title  than  to  o  short  obstract. 


Therefore  please  do  not  name  us  on  isolated  concept  ~  radioactive  strontium  compounds  -  for  which  you 
might  yourself  feel  inclined  to  look  in  title  lists  or  subject  indexes.  Concerning  radioactive  strontium 
compounds  alone  we  have  got  more  than  3000  literature  quotations  stored  in  the  memory  of  the  Computer. 
Such  a  mass  would  overburden  you.  Our  Computer  is  in  need  of  a  meaningful  combination  of  significont 
concepts,  which  we  shall  elaborate  from  the  query  formulated  by  you;  this  will  be  the  only  woy  for  you  to 
obtain  the  abstracts  you  are  really  looking  for. 


One  thing  is  certain  : 

The  more  accurately  you  word  your  query,  the  more  precisely  you  will  know  what  you  wont  to  know, 
and  the  better  you  will  learn  what  our  Computer  knows  about  it. 


W©  shall  not  toll  anybody  what  you  want  to  know  « 
but  wo  shall  toll  ovoryLody  what  you  havo  published 


At  tho  pfosorit  timo,  sterch^s  art  corritd  out  frt#  of  charpt,  on  condition,  thot  is,  thot  you  givt  us  your  commtnts  on  th#  informotion 
rtctivtd  (ro'n  us  (« fttdbock •).  **  Wt  do  not  oectpt  ony  responsibility  conctrning  tho  accurocy,  compltttr>tss  or  utility  of  the 
documtnts  ntontiontd  by  us. 


Address;  CID/ENDS,  29,  rut  Aldrinptr,  Luxembourg  —  Tel,;  29241  -  Telegraphic  oddrtss  :  «COMEUR  Luxembourg* 

Telex;  tCOMEURLUX  423  or  446* 


Figure  2 
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(tS- 

COMMENTS 

ON  LITERATURE  SEARCH 

Th«t*  comments  or*  th«  only  conip«naa<ion  w«  cak  from  you  (or  procossing  your  query. 

Subject  of  starch: 


1.  I  do  not  require  any  lupplemenrsry  references 

2.  Please  keep  tne  requiorly  informad  on  this  subject 

3.  i  should  like  to  receive  further  references  published  after 

4.  I  misted  references  eoriceming; 

5.  I  do  not  require  any  references  coiiceming; 

6.  I  hove  modified  my  query  os  follows: 


PI«ott  in  Mch  column,  up  fo  ten  compUtt  reference  numbers  relotinp  to  clear  *  hits  ”  (Columns  "o”  and 

*b”)y  and  to  door  *  noise"  (Column  "d").  In  oddition  to  the  reference  numbers  pive  the  totol  number  of  references 
per  column. 

Amortg  the  references  supplied,  the  following  were; 

Quote  bibiiogrophicoi  doto 
in  full.  Use  a  seporote 
sheet  if  necessory 

«) 

pertinent,  but  alreody  known 

b) 

pertinent  and  new 

c) 

not  just  pertinent, 
but  useful 

d) 

outside  subject  limits, 
ond  so  of  no  interest 

•) 

references  not  supplied, 
oithougK  pertinent 

1 

i 

1 

1 

1 

i 

1 

1 

i 

1 

1 

! 

Dote :  Signature : 


Adrfrttf;  CIO/ENDS,  29,  rut  Aldtinjsr,  (.ussoibourg  -  T«l.;  29241  -  Tvisjrophic  addrttc  tCOMEUR  Lu»*mbourgi  -  T«I««t 

iCOMEURLUX  423  or  444  • 


Figure  3 
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COMMISSlOH  OF  THE  EUROPEAN  COMMUNITIES 

Dir«ctc<otc  G«ntral  *Dis»*fflination  of 
C  I  D 


OocomoRtotion 


Dote: 


LITERATURE  SEARCH 

REOUEST 

1.  FIRM  OR  ORGANIZATION; 

Requester's  name; 

Address  for  correspondence: 

Telephone/ telex  No.:  Extension  No.; 

2.  SUBJECT  OF  THE  SEARCH; 

(Define  the  subject  with  enough  precision  so  thot  a  documentolist  speciolized  in  your  field  but 
not  necessarily  acquainted  with  your  particular  subject  can  thoroughly  understond  the  question, 
and  also  recognize  what  would  not  be  of  interest  to  you).  To  help  us  pinpoint  your  problem,  please, 
mention  a  few  relevant  documents  end,  if  possible,  supply  a  copy  of  their  first  page. 


Pnauaatic  devices  for  control  purposes 


3.  PURPOSE  OF  THE  SEARCH; 

a)  I  would  like  to  have  a  general  view  on  the  subject  of  my  request  (to  become  ac¬ 
quainted  with  0  new  field  or  on  urgent  technical  problem). 

b)  I  would  like  to  complete  my  awn  bibliography  in  my  specialized  field  or  check 
its  completeness. 

!  already  know _  relevant  publications. 

The  search  should  be  limited  to  documents  puhSishad  after _ 

For  this  period,  I  expect  to  receive - references. 

c)  Con  you  quote  me  any  documents  published  prior  to _ end 

possibly  Impairing  the  novelty  of  the  inventive  idea  exposed  under  Item  2? 

4.  ANY  OTHER  REMARKS; 


□ 

n 

□ 


5.  Please  tend  me  one  copy  of  every  abstract  pertinent  to  my  query.  I  am  owars  of  the  fact  that  I  may  use 
such  coplei  en'y  for  pertonol  ends  and  not  divulge  them  (handing  over  of  cepiee  to  etoff  members  working 
with  my  own  employer  is  not  deemed  to  be  divulgotion),  ond  thot  the  outhor  is  entitled  to  o  fair  remunerotion 
if  the  reproduction  serves  commerciol  purposes. 


(signoture) 


Figure  4 
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Pneumatic  devices  for  control  purposes 


PNEUMATICS  •  (CONTROL  +  CONTROL  SYSTEMS  +  REMOTE  CONTROL) 


Figjre  5 


I 

) 

AMPLIFIERS  *  (FLUIDS  +  FLUID  FLOW) 


Figure  7 


Control  of  the  operation  of  power  reactors 
by  computers 

(CONTROL  +  CONTROL  SYSTEMS  +  MONITORING) 

*  (OPERATION  +  STARTUP  +  SHUTDOWN) 

*  (POWER  PLANTS  +  REACTORS) 

*  (COMPUTERS  +  DIGITAL  SYSTEMS  +  ANALOG  SYSTEMS) 

+  means  "or" 

*  means  "and" 

Figure  8 

(CONTROL  +  CONTROL  SYSTEMS  +  MONITORING  +  OPERATION 

+  STARTUP  +  SHUTDOWN) 

*  (POWER  PLANTS  +  REACTORS) 

*  COMPUTERS 

*-  (NUMERICALS  +  SIMULATORS) 

*-  means  "and  not"  660  answers 

480  hits 

73  %  relevance  ratio 

Figure  9 


l80  answers 
kO  hits 

22  %  relevance  ratio 


COMMENTS 

ON  LITERATURE  SEARCH 


These  comments  are  the  only  compensation  we  osit  from  you  for  processing  your  query. 


Subject  of  search: 


1.  I  do  not  require  any  supplementary  references 

2.  Please  keep  me  regularly  informed  on  this  subject 

3.  I  should  like  to  receive  further  references  published  after 

4.  I  missed  references  concerning; 


5.  I  do  not  require  any  references  concerning: 


6.  I  hove  modified  my  query  os  follows: 


Fluid  amplifiers 


Pleoic  indicate,  in  each  column,  up  to  ten  complete  reference  numbert  relotin9  to  cieor  *hltK*  (Columns  *0"  ond 
"b"),  and  to  cieor  "  noise  *  (Column  "d").  In  oddition  to  the  referertce  nt^nbers  give  the  totol  number  of  references 
per  column. 

Among  the  references  supplied<  the  following  were; 

Quote  bibliogrophicsl  doto 
in  fuli.  Use  e  seporote 
sheet  if  necessory 

0) 

pertinent,  but  already  known 

b) 

pertinent  end  new 

e) 

not  |ust  pertinent, 
but  useful 

d) 

outside  subject  limits, 
end  so  of  no  interest 

•) 

references  not  supplied, 
oltheugh  pertinent 

NS  20  08442 

ST  65  29183 

the  remaining 

68  references 

Dote ; 


Signature ; 


Addrtit:  CID/END5.  29,  rut  Atdringtr,  LuMimbeurq  »  T«t,:  292 -  TtUgrophic  oddrtss;  tCOMEUR  Luntmbourg*  Ttltn; 

•  COMEURLUX  122  or  446  • 


rigure  6 


USER'S  EFFORT 


Searching  via  aingle 
term  entries  (headings) 
In  alphabetic  Indexes; 
Instant  feedback  for 
precising  the  query 


TRADITIONAL  DOCUMENTATION  SYSTEM 


Subject  Indexes 

Library  Card  Files  (alphabetic) 

Abstract  Journals 


USSR 


USER'S  EFFORT 

SYSTEM'S  DOCUMENTALIST 

Forfflulating  a 
precise  query, 
comaenticg  on 
results  and  re¬ 
phrasing  the 
query  if  necess¬ 
ary  (delayed 
feedback) 

Interpretation  and 
formulation  of  the 
query  by  logical  co¬ 
ordination  of  search 
terms;  checking  the 
results,  and  reform.il- 
atlon  of  the  query  If 
necessary 

COMPUTERIZED  DOCUMENTATION  SYSTEM 
with  Coordinate  Indexing  and 
Retrieval 


Pig. 10  User' s  effort  in  applying  to  documentation  systems 


Isotope  enrichment  for  uranium  233  hy  ultracentrifuges 


ISOTOPES  *  ENSICHMENT  * 


URANIUM  235  • 


ULTRACENTRIFUGES 


ISOTOPE  SEPARATION  *  (URANIUM  235  URANIUM  ISOTOPES)  *  ULTHACENTRIFUaSS 


Figure  11 
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by 


J.R. Buchanan 


Nuclear  Safety  Infornation  Center, 
Oak  Ridge  National  Laboratory, 
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SlIMMARV 


CcMOputerization  can  enable  an  intermediate-size  information  analysis  center  (2,000  to 
12,000  accessions  per  year)  to  most  efficiently  use  its  professional  and  clerical  staff  and 
to  prepare  for  growth.  In  order  to  make  effective  use  of  its  funds  and  prepare  for 
expansion  or  increased  scope,  it  is  important  to  plan  ahead  for  the  collection  of  opera¬ 
ting  data  that  will  permit  cost  analysis  of  the  various  production  operations  connected 
with  collecting,  processing,  and  outputting  the  services  offered.  Measurement  of  user 
response  and  effectiveness  of  the  services  are  vital  to  this  analysis.  The  experience  of 
the  Nuclear  Safety  Information  Center  and  other  information  analysis  centers  will  be  used 
to  illustrate  how  this  has  been  done 


SOMMAIRE 


Le  recours  A  I’ordinateur  peut  permettre  A  un  centre  d’ analyse  d’ informations  d’ import¬ 
ance  moyenne  (de  2,000  A  12,000  admissions  par  an)  d’obtenir  le  meilleur  rendement  possible 
de  son  personnel  technique  et  acHinistratif,  et  de  prdparer  son  expansion,  il  est  important, 
si  I'on  veut  utiliser  efficacement  ses  fonds  et  se  prAparer  A  s’accroltre  ou  A  e'tendre  le 
champ  de  ses  activit^s,  de  pr^voir  A  I’avance  le  recueil  d’ informations  sur  le  fonctionne- 
ment,  qui  pemettront  de  proc^der  A  1’ analyse  du  coOt  des  diverses  operations  de  production 
nees  au  recueil,  au  traitement  et  A  la  production  des  services  offerts.  La  nesure  de  la 
reaction  de  I'utilisateur  et  de  I'efficacite  des  services  est,  pour  cette  analyse,  d’une 
importance  vitale.  Pour  illustrer  comment  ceci  a  4te  re'allse',  r auteur  rendra  compte  de 
r experience  du  Centre  d’ Information  de  la  Securite  Nucieaire  ainsi  que  d’autres  centres 
d' analyse  d'  informations. 
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EVALUATION  AND 
INFORaATION 


COST  ANALYSIS  OF  COIPUTERIZED 
ANALYSIS  CENTER  OPERATIONS* 


J.R.  Buchanan 


An  infomtion  analysis  center  may  be  thought  of  as  a  aanufscturing  concern  where  infoniation  and/or  data 
is  processed  in  various  fom  during  well -denned  production  operations.  Finished  products  are  distributed  to 
users  who  originate  requests  for  relevant  b  ial  on  particular  subjects.  The  aanagenent  function  of  a  center 
is  therefore  soaewbat  analogous  to  that  of  a  Manufacturing  fira,  i.e. ,  the  enterprise  is  concerned  with  the 
saae  basic  functions  of  purchasing,  production,  service,  finance,  adainistration,  and  distribution*.  It  is  in 
this  fashion  that  evaluation  of  processes  and  cost  analysis  becoaes  iaportant.  In  this  case,  we  are  particu¬ 
larly  interested  in  their  application  to  coaputerized  activities. 

The  significance  of  coaputerized  operation  is  that  it  can  enable  aanageaent  to  aake  aost  effective  use  of 
its  personnel  and  the  single  aost  iaportant  facet  of  the  operation  of  an  inforaation  analysis  center  (lAC)  is  its 
staff  of  experienced  scientists  and  engineers.  At  the  Nuclear  Safety  Inforaation  Center  (NSIC)’-’  and  other 
siailar  organizations,  these  technical  speciali.'its’  duties  Include  preparing  review  articles  and  reports, 
answering  technical  inquiries,  and  cataloging  reference  aaterial. 

Rhile  the  principal  functions  of  the  first  two  tasks  are  not  coaputerized,  they  involve  the  greatest  portions 
of  the  tine  of  the  technical  staff  and  are  vital  to  the  operation  of  an  effective  lAC.  Ooaputerization  enables 
such  a  center  to  aost  efficiently  use  its  professional  and  clerical  staff  and  prepare  fur  growth.  Benefita 
that  can  result  froa  aechanization  include: 

Increased  service 

Faster  service 

More  search  flexibility 

Greater  scope  expansion  flexibility 

Lower  personnel  costs 

In  this  paper  the  experience  of  a  nuaber  of  organizations  including  N51C  will  be  utilized  to  illustrate  how 
cost  data  aay  be  collected  and  bow  effectiveness  or  user  satisfaction  any  be  aeasured.  Goae  coaparative 
stateaents  on  annual  and  coivMiterlsed  operations  are  presented  followed  by  a  suMary  of  cost  analysis  criteria 
and  evaluation  criteria.  Next  cones  a  discussion  of  cost  and  effectiveness  practices  followed  by  a  suMary  of 
real  problean  of  coaputerized  operations  that  have  been  identified  by  lAC  aanagers. 

Ceapariaoa  of  Maiaal  and  Coaputerized  dperatioaa 

Since  the  subject  of  this  paper  is  the  coat  and  analysis  of  coaputerised  operations,  it  is  aiiuaed  that  this 
audience  either  is  involved  in  such  an  activity  or  is  strongly  considcrins  coaputerlzation.  For  those  still 
using  a  nanual  systeo  or  only  recently  converted  to  the  coaputer.  It  is  of  soae  interest  to  cuapare  the  two 
aodes  of  operation.  Unfortunately,  facilities  with  coaputerized  operations  that  fomerly  were  aanual  have 
generally  not  atteapted  to  coapare  the  two  aethoda  except  in  superficial  ways.  The  Boos,  Allen  study  of  Mech¬ 
anization  in  DQP  Libraries  and  Inforaation  Centers*  did  contain  soae  interesting  qualitative  evaluations  of  the 
effectlvencas  of  their  own  aechanized  aysi^eus  hy  several  facilities'  staffs.  (Although  soae  of  the  data  was 
froa  library  operation.  It  is  included  here  because  of  its  general  interest  Md  Che  scarcity  of  this  type  of 
inforaation. ) 

|.  At  the  Flcattnny  Arsenal,  a  coaputerized  ayatea  took  an  average  of  0.  IS  hour  per  itea  for  keypunching, 

sorting,  pulling  froa  shelves,  preparing  for  aail.  discharging  refiling  returns,  and  processing  on  the 

coaputer  The  aanual  ayatea  reqslied  0. IB  hour  per  itea. 

2.  The  Technical  Inforaation  Reference  Branch  at  Bright-Patteraon  AFB  has  been  able  to  produce  kiy  coaputer  a 
regular  accessions  list  twice  per  aonth  with  no  increase  in  effort  or  aanpower.  In  the  eight  years 
precedi  .g  aechaniastion.  the  Branch  was  able  to  produce  aanually  only  one  list  every  other  aonth. 

3.  The  US  Naval  Postgraduate  School  Lihrary  now  devotea  about  10  to  IS  ainutes  each  to  MO  atudent  rv«tests 

per  aonth  sith  a  coaputer  systea.  saving  ahe  *  'C?  aan  hours  per  aonth  Foraerly  ih  hours  sms  required 

for  prcfeasional  assistMcc  sith  an  avert'**  manual  search. 


*  Research  tpeasortd  by  the  M  Atoaic  fcergy  Ocantssloi  nsCtr  coalrscl  sllh  the  UHm  Carbide  OOrporatigi. 
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4.  Hie  Air  Force  Materials  Laborntorr  Library  Staff  found  that  reference  searches  produced  by  the  computer 
caused  a  reduction  of  irrelevant  information  of  over  56%  and  Incurred  less  than  a  5%  loss  of  relevant 
information. 

5.  Hie  staff  at  the  Redstone  Scientific  Information  Center  «as  able  to  perform  a  greater  volume  of  library 
service  at  a  saving  in  staff  time  through  computerization.  In  1962  a  staff  of  67  was  required  to  serve 
4000  users.  After  mechanization  in  1965,  there  were  8300  users,  while  the  staff  had  been  decreased  to 
43  members,  with  no  increase  in  overall  workload  on  the  staff. 

6.  Hie  Infrared  Information  Analysis  Center  was  able  to  answer  live  tines  as  many  requests  after  computeriza¬ 
tion  as  before.  Prior  to  going  on  full-time  computer  use,  IRIA  per'^nnnel  required  two  to  three  days  to 
prepare  a  bibliography  for  a  visitor.  Hie  tiae  now  required  averages  one  and  one-half  hours. 

7.  In  1964  the  Foreign  Technology  Division  Library  at  Wright-Patterson  conducted  a  controlled  experiment  on 
a  data  base  of  100  documents.  The  computer  search  based  on  30  user  profiles  retrieved  an  average  of  85 
documents.  Hie  manual  searches  yielded  45  documents.  Of  those  45,  about  15%.  or  seven  decuments.  had 
been  missed  by  the  computer  search.  Relevance  levels  were  58%  on  the  computer  search  and  63%  on  the 
manual  search. 

8.  Conversely,  all  four  of  the  information  centers  at  the  Battelle  Memorial  Institute  that  were  included  in 
the  survey  consider  that  their  aanually  produced  and  searched  files  of  extracts  are  preferable  to  a  com¬ 
puterised  system.  However,  computerization  of  the  center’ s  printed  outputs  will  be  considered  for  time¬ 
saving  features  where  it  is  felt  to  be  economica'.ly  advantag'^ous. 

Cost  Amalysia  Criteria 

The  noat  Important  measures  of  system  walysis  are  (1)  cost.  (2)  performance,  and  (3)  benefits  and  their 
interrelationships.  Coat  describes  the  expense  of  the  system  in  dollars.  System  performance  is  determined  by 
such  attributes  as  accuracy,  speed,  quality,  extent  of  coverage,  etc.  Benefits  describe  xbe  consequences  of 
the  system  in  terms  of  (1)  its  value,  determined  from  such  factors  as  number  of  references  used  per  year  or 
duplication  of  research  avoided:  (2)  how  the  system  affects  the  behavior  of  persons:  or  (3)  how  it  affects 
related  systems.  A  theoretical  beneflt-cost-performancc  described  by  Murdock  and  Liston’  is  found  by  plotting 
a  benefit  to  coat  ratio  against  percentage  of  maxiaum  possible  performance.  This,  of  course,  requires  sJl 
beneftvs  of  the  systen  to  be  convertible  to  dollars  and  this  is  not  always  possible. 

Viile  libraries  do  not  generally  maintain  coat  data,  information  center  management  conversely  is  generally 
very  concerned  about  costs  and  maintains  detailed  records  of  current  operating  costs.  However,  even  in  these 
cases,  historical  development  costs  are  usually  not  available.  Booz  Allen*  felt  that  incomplete  cost  records 
and  Insufficient  concern  relative  to  cost  versus  usefulness  snd  value  was  pro^-ably  the  most  detrimental  influ¬ 
ence  on  the  development  of  many  of  the  systems  they  studied. 

The  toUowlng  criteria  relative  to  cost  analysis  soem  taste: 

|.  hxrpott  of  Colltrling  Cost  Informatton  •  The  purpose  of  assembling  cost  information  is  to  enable  manage- 
ment  to  compare  fund  consumption  with  allocation.  The  allocation  is  usually  specified  by  a  budget  which 
should  reflect  tl>f  Judgment  of  management  concerning  M.c  relative  value  of  each  activ'ty,  both  tangible 
and  iatangible.  Pbr  computerised  activities,  this  meant  including  the  value  of  such  elements  as  increased 
timeilneaa.  flexibility,  and  quality,  broader  and/or  deeper  search  capability,  greater  file  detail: 
increamed  user  auttafaetton.  etc.  These  seme  elements  tbould  alto  be  used  in  measuring  the  operating 
ayatama  afftciivaneaa  thereby  providing  a  tmo-way  check  -  budget  versus  coat  and  expected  value  versus 
actual  effect tveoMa. 

i.  Badgtt  Xevixton  -  The  budget  will  be  subject  to  reviaion  baaed  upon  the  availability  of  funds  and  changina 
views  on  tha  value  of  ayatca  elements  end  output  The  budget  should  reelist ical ly  reflect  the  antlrtpated 
vaitue  of  the  developing  ayaitm  as  w«ll  ma  the  available  funds.  Costa  should  be  recorded  as  they  accumu¬ 
late,  iBcludiag  remaonable  catimatea  for  those  services  that  are  siwlied  ’’free”.  They  ran  then  be  related 
to  the  budget,  the  coats  of  the  old  system,  and  the  effectiveness  of  the  new  system.  The  budget  nor  then 
b«  modified  to  direct  the  available  funds  to  those  arras  that  will  yield  the  arealest  return  in  terms  of 
the  iomla  eatnbtiabed. 

3.  C^(  fteamii  •  The  elsmenta  that  make  up  the  overall  coat  of  romputerised  processes  include. 

Staff  salaries 
■tat trial  a 

Bqsipmtat  onrehase  or  rental 

Equipment  spmee  requirements 

Haintenance 

Computer  time 

Programming 

contractor  services 

Dreclopmant  of  new  ski  11a 
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Diese  cost  eleoents  after  being  asoeabled  nust  be  related  to  various  units  of  the  operation,  cost  per 
acquisition  cataloged,  per  search,  per  dissemination,  etc.  Ihese  figures  then  permit  a  cost  analysis  of 
the  computerized  processes  in  terms  of  budget  and,  combined  with  the  operation  statistics,  a  determination 
of  cost  effectiveness.  Finally,  these  figures  can  be  maintained  from  year  to  ye*r  to  develop  an  historical 
cost  basis  for  comparisons,  decisions  regarding  future  budgets,  staff  assignments,  and  r*<tnge8  in  services 
offered  to  the  users. 

King‘  has  identified  several  papers  on  computer  and  programing  costs  of  interest  to  syster  designers  and 
evaluators  -  including  Erikson’,  Marron  and  Gynderman',  Nel8on*'‘°,  liipac"  and  Weinmum’’. 

Evaluation  Criteria 

In  introducing  the  subject  of  evaluation,  Salton^^  has  sfaoan  that  it  is  necessary  to  make  a  number  of  dis¬ 
tinctions  because  (1)  there  are  different  kinds  of  systems  (operational,  experimental,  and  laboratory),  (2) 
there  are  different  viewpoints  concerning  the  system  (user,  manager,  operator),  and  (3)  systeaw  are  composeu  of 
many  subsy^^tems.  Tterefore,  many  different  variables  are  identified  which  affect  system  evaluation.  Salton 
identifies  tne  folloving  factors  as  among  the  most  important; 

1.  User  Population  -  Trpe  of  user,  rate  of  requests,  etc. 

2.  Collection  -  Coverage  of  collection,  type  of  document  available  at  input,  reliability  of  abstracts,  etc. 

3.  Indexing  -  lype  of  indexers,  level  and  accuracy  of  indexing,  depth  of  indexing  required,  and  complexity 
of  indexing  language  required. 

4.  Analysis  and  Search  -  Type  at  searching,  poser  and  complexity  of  search  mechanism,  search  effort  required, 
accuracy  of  search,  etc. 

5.  Equipment  and  Input-Output  -  Type  of  store,  type  of  in-out  equipment,  and  type  and  form  of  output. 

6.  Operating  Efficiency  -  Cost  considerations  service  problems,  tine  lag,  and  response  time. 

Treu*'*  in  a  literature  survey  found  six  different  test  and  evaluation  methods  that  had  been  applied  to  both 
individual  systems  and  comparison  of  systems.  These  are; 

1.  Search  and  system  response  procedure  involving  a  request,  interpretation  of  sane,  query  formation,  and 
evaluation  of  results. 

2.  Out-of-aysten-service  procedure  for  testing  one  or  more  selected  system  elements  or  functions. 

3.  The  questionnaire  and  interview  technique  for  determining  user  requirements  and  evaluating  ayatem  aervice. 

4.  Observation  of  the  operating  system  for  such  things  as  workload,  staff  performance,  and  aystem  operation. 

5.  Simulation  by  such  means  as  aathemstlcal  models. 

6  Multiple  approach  using  two  or  more  of  the  above  methods. 

Many  feel  that  the  overriding  criterion  for  evaluating  effectiveness  la  the  ability  of  a  system  to  satisfy 
the  user  and  that  the  principal  alas  of  the  other  participants,  such  as  managers  and  operators,  are  the  same. 
Cleverdon”  recognises  six  ma'n  user  criteria  which  affect  his  satisfaction; 

I.  The  coverage  of  the  collection  or  the  ex' tint  to  iStich  the  system  Includes  relevant  matter. 

3.  The  time  lag  or  average  interval  between  the  time  the  search  request  is  made  and  the  time  an  anseer  is 
given. 

3.  The  form  of  presentation  of  the  output. 

4.  The  effort  involved  on  the  part  of  the  user  in  obtaining  anasera  to  his  search  reqeests. 

5.  The  recall  of  the  syatam  is  the  proportion  of  relevant  material  actually  retrieved  in  answer  to  a  search 
request . 

6.  The  precision  of  the  system  is  the  prxiporlioo  of  retrieved  material  that  la  actually  relevant. 

Cullection  of  Oaat  and  hffectiveneaa  Infnraatlen 

Most  of  the  papers  published  -?a  the  evaluation  of  information  sysiama  dwelt  on  meamurea  of  the  recall  and 
precisian  of  the  information  storage  system.  Miile  these  are  ii^rtant  tests,  it  is  possible  that  they  have 
been  over-emphasised  relative  to  other  means  of  test  and  evaluation  becanse  they  are  usually  easier  to  measure 
and  report  in  a  meaningful  fashion,  la  this  section  we  look  at  other  sethoda  such  as  feedback  and  cost  measure- 
nent. 


User  Mewponae 

NSIC  has  employed  various  means  of  getting  feedback  from  the  user  and  measuring  user  satisfactions.  Bach 
set  of  SDI  abstract  cards  nailed  from  the  Center  has  a  ferdbnek  card  that  has  beea  prepared  by  the  computer. 

A  typical  card  is  shows  in  Figure  I.  The  system  has  1700  users  and  output  la  prepared  and  sent  out  bi-neekly. 
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Profile  adjustments  are  made  on  tlie  basis  of  feedback  received  from  the  users.  The  procedure  has  been  pre- 
viouslj  described'®. 

Questionnaires  have  also  been  used  by  NSIC  to  evaluate  services.  A  typical  one  is  shown  in  Figure  2. 

Dugger  and  Klinger"  have  attempted  to  determine  by  questionnaire  the  value  of  information  received  from  an 
i.iformation  system  in  terms  of  dc'.lars  or  man  hours  saved  by  preventing  duplication  of  effort,  loss  of  tine, 
etc.  While  users  of  information  systems  freque.itly  save  time  and  money  in  this  fashion,  it  is  almost  impossible 
to  cbtain  meaningful  numbers  on  the  exact  amount  of  the  saving. 


Cost  Evaluation 

lb'-  cost  and  budgeting  experience  of  NSIC  and  the  Aerospace  Research  Applications  Center  (ARAC)  at  the 
University  of  Indiana  will  now  be  diECU.ssed. 

NSIC  Budget  -  All  projects  at  Oak  Ridge  National  Laboratory  (OftNLl  have  their  operating  costs  tabulated  each 
month  by  computer.  A  copy  of  the  Operating  Cost  Report  for  NSIC  for  May  1969  is  shown  in  .''igure  3.  While  there 
is  a  detailed  breakdown  of  personnel  cost,  the  computer  expenses  are  reported  as  a  single  line  item  a.s  “EDPfCDP 
&  ORNL)”.  More  detailed  charges  for  data  processing,  programming,  and  remote  consoles  are  reported  in  a  sep¬ 
arate  form. 


Using  cost  figures  developed  in  this  fashion,  it.  has  been  possible  i'  determine  the  expense  of  doing  basic 
operations  and  to  budget  the  various  activities.  At  NSIC  the  budget  for  FY-69  was  allocated  as  shown  in  Table 
I  All  computer  charges  are  lumped  under  one  item  so  that  the  other  entries  such  as  SOI  are  for  expenses  at 
NSIC  exclusive  of  computer  costs.  The  expense  of  doing  various  computerized  operations  on  the  IBM-7090  is 
shown  in  Table  II.  Comparable  figures  for  the  IBM- 360  are  not  available  due  to  limited  operating  experience  to 
date  in  the  new  production  mode" 

NSIC  Input  -  Abstracting  and  inueiing  costs  associated  with  technical  editing  and  clerical  efforts  was 
$11.10  per  abstract  in  FY-69.  It  cost  an  additional  $1.40  to  store  each  abstract  on  the  computer  for  a  total 
cost  of  $12.  50.  We  have  no  figures  <''om  comparable  systems  for  direct  comparison;  however,  one  large  abstracting 
service  unofficially  reported  that  ii  cost  them  $20  per  abstract  to  index,  abstract,  and  produce  finished  copy 
for  an  abstract  journal. 

NSIC  Indexed  Bibliography  -  NSIC  reports  are  sold  for  $3  per  copy  by  the  Clearinghouse  for  Federal  Scientific 
and  Technical  Information  (CPSTI).  Since  the  Indexed  Bibliographies  are  issuvcd  bi-monthly,  this  made  a  yearly 
set  cost  $18  for  a  total  of  4820  abstracts  in  Fy-69  The  production  expense  of  $4.58  per  copy  is  essentially 
all  associated  with  printing  since  the  $50  computer  cost  amounts  to  onlv  8  certs  per  copy  for  the  present  print 
run  of  628.  The  printing  costs  were  paid  from  ORNL  overhead  funds  in  PY-69  but  will  be  charged  directly  to 
NSIC  in  Fy-70.  None  of  the  abstracts  input  costs  have  been  charged  against  the  Bibliography  since  it  is  thought 
of  as  a  by-product  primarily  for  library  use.  (The  abstracts  must  be  in  the  storage  file  anyway  so  that  the 
SOI  and  retrospective  search  programs  can  function.)  For  comparative  purposes  we  note  that  a  commercial  publi¬ 
cation  Chemical  Abstracts  had  an  annual  subscription  rate  of  $1550  in  1968  when  it  contained  232.704  abstracts 
for  an  average  cost  to  the  subscriber  of  0.67  cents  per  abstract.  (If  the  cost  were  set  for  full  recovery  of 
printing  expenses,  the  NSIC  charge  would  be  0. 57  cents  per  abstract. ) 

NSIC-SDI  -  At  present  there  is  no  charge  for  the  SDI  service  although  NSIC  has  surveyed  its  users  to  help 
determine  what  it  is  worth  to  them.  One  hundred  questionnaires  were  mailed  at  random  asking  what  they  would  be 
willing  to  paj’  for  the  service.  A  total  of  69  forms  were  returned  with  the  following  results. 


1.  42  willing  to  pay 
20  not  willing  to  pay 

7  returnea  form  but  did  not  answer  question 


Pees  checked  were 
23  -  $  25/yr 
9  -  $  50/yr 
3  -  $100/yr 


and  write-ins  were 

1  -  $  5/yr 

2  -  $  10/yr 
1  -  $400/yr 


The  cost  to  NSIC  of  selecting,  sorting,  printing,  and  mailing  SDI  is  about  7  cents  per  abstract  and  the 
average  user  receives  about  15  abstracts  every  one-to-two  weeks.  The  yearly  cost  is  $51.05  including  the 
expense  of  profile  maintenance  and  billing  and  fee  collection.  Input  costs  add  an  additional  yearly  charge  of 
$4.32. 


Die  USAEC  has  yet  to  reach  a  decision  as  to  its  policy  on  charges  for  information  center  services.  An  AEC 
Technical  Information  Panel  Task  Force  has  recommended  that  these  services  not  be  considered  in  the  general 
category  of  "Ooods  and  Services”  and  that  the  sponsoring  program  division  recognize  the  need  to  budget  all 
information  activity  costs  except  those  of  an  unusual  nature  for  unusual  needs. 

NSIC  Consultation  and  Retrospective  Searches  -  During  the  past  year.  NSIC  responded  to  609  technical  inquiries, 
.he  average  non-compuier  related  cost  of  replying  to  each  was  $75.70.  Most  of  the  expense  is  a  direct  result 
of  the  amount  of  technical  consulting  time  required.  About  2/3  of  the  inquiries  also  required  backup  refer¬ 
ences.  This  resulted  in  over  400  retrospective  searches.  The  computer  associated  cost  of  a  search,  as  we  have 
seen  earlier,  .  $25  when  they  r.re  processed  in  batches. 
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AMC  Experience  -  At  ARAC.  a  coaputerized  cost  s.TsteB  *as  devel-'sed  by  Helakaap*  and  operated  for  a  3-Bonth 
period  to  show  that  it  is  possible  to  design  a  sound  cost  accounting  s;stea  to  aeet  the  specific  reigiireaents 
of  an  infoniation  center.  The  coaponents  of  the  systea  aere  designed  specifically  for  ARAC.  These  included 
such  iteas  as  labor  tiae  records,  work  orders,  labor  perforaance  reports,  and  service  cost  reports.  An  abbre¬ 
viated  Bonthly  cost  perforaance  report  is  shorn  in  Table  III.  Using  the  various  basic  cost  data,  cost  distribu¬ 
tions  aere  developed  for  retrospective  searches  and  SDI  as  shoan  in  Table  IV. 

There  hai.  been  no  atteapt  to  coapare  the  cost  figures  collected  by  NSIC  and  ARAC  since  a  good  deal  of 
noraalization  aould  be  required  to  put  thea  on  the  rooe  basis.  The  point  to  be  aade  is  that  data  aere  collec¬ 
ted  and  reported  in  the  fashion  aost  useful  to  each  particular  aanageaent  group.  It  is  obvious  froa  the  experi¬ 
ence  of  these  two  centers  that  aeaningful  cost  and  effectiveness  data  can  be  collected.  The  essential  ingredi¬ 
ents  are  to  plan  early  for  its  collection  and  to  design  a  systea  that  alloas  for  easy  interpretation  of  results. 

Probleas  Related  to  Coaputer  Operations 

Sone  general  probleas  related  to  use  of  conputers  by  lACs  have  been  identified  since  they  ultiastely  have  an 
effect  on  costs  and  effectiveness.  Typical  probleas  are  as  folloas: 

1.  Computer  Service  -  Soae  groups  are  forced  to  rely  on  other  organizations  for  coaputer  services.  This  can 
result  in  service  that  is  erratic  and  soaetiaes  unavailable  for  extendeo  periods  of  tine. 

2.  Changeover  -  Bringing  a  coaputer  storage  and  retrieval  systea  into  operational  use  is  greatly  coaplicated 
by  the  problems  of  file  conversion.  Computer  searching  is  effective  only  if  a  substantial  part  of  the 
file  to  be  searched  is  accessible  to  the  coaputer.  However,  the  creation  of  a  coeplete  aacbine  file  often 
initially  exceeds  the  funds  available  and  the  file  conversion  process  aay  have  to  be  stretched  out  over  a 
long  period.  This  experience  can  be  frustrating  and  discouraging  to  both  the  user  and  the  searcher'. 

3  Staffing  -  Inforaation  facilities  frequently  consider  theaselves  to  be  understaffed  for  the  job  expected 
of  them.  Some  of  the  difficulty  in  bringing  a  coaputer  process  into  operation  can  be  attributed  to 
insufficient  staff  for  organizing  the  systea  and  preparing  aaterial  fur  coaputer  input'. 

4.  Organisation  -  Centers  reporting  to  research  and  developaent  staff  aanageaent  generally  feel  that  they 
have  much  better  support  for  their  computerization  efforts  (as  well  as  tbeir  other  activities)  than  do 
those  reporting  to  adainistrative  management'. 

5.  Expense  of  Computerized  Activities  -  The  amount  of  money  spent  on  computerized  activities  by  NSIC  has 
increased  each  year.  This  presents  a  problem  because  of  increasingly  tight  budgeting  times.  It  is, 
however,  a  tribute  to  the  success  of  the  computer  programs  in  that  more  use  has  been  made  of  then  than 
was  ever  envisioned  when  the  work  was  started.  Also,  to  perform  as  many  activities  manually  as  are 
currently  being  done  on  the  computer  would  certainly  cost  .'-jusiaerably  more.  At  present,  about  one-third 
of  NSIC' s  budget  is  consumed  in  computer  program  development  and  operation. 

6.  Desire  to  do  More  on  Computer  -  The  desire  to  do  even  more  on  the  computer  frequently  exceeds  the  pro- 
grainr'ng  manpower  and  time  available  to  provide  needed  programs  or  revisions.  It  becomes  necessary  to 
establish  priorities  for  even  .he  small  jobs.  Again,  at  NSIC  this  is  considered  a  tribute  to  the  success 
of  the  existing  programs. 


Conclusion 

The  most  efficient  use  of  the  professional  and  clerical  staff  of  an  lAC  can  be  made  by  a  balanced  program  of 
mechanization.  However,  it  is  very  important  to  plan  early  for  the  collection  of  operating  data  that  will 
permit  cost  analysis  of  the  various  center  operations.  This  will  enable  the  managers  of  the  operation  to  make 
most  effective  use  of  their  funds  and  plan  for  the  future. 
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TABLE  I 


NSIC  Bndset  for  FV'6B 


Operation 

Cost 

Percent 
of  Budget 

1 - 

1  Abstracting  and  Indexing  (8753  ftbstrscts) 

Technical 

$  52.  COO 

13.7 

Editing 

15,000 

3.9 

Clerical 

30,000 

7.9 

SUB  TOTAL 

97,000 

25.5 

SDI 

Technical 

16. 000 

4.2 

Clerical 

2,000 

0.5 

SUB  TOTAL 

18,000 

4.7 

! 

Consultation  &  Retrospective  Searches 

Technidal 

37,000 

9.7 

Clerical 

9,000 

2.4 

SUB  TOTAL 

46,000 

12.1 

Reports  and  Revieu  Articles 

63.000 

16.6 

Computer  Activities 

136, 000 

35.8 

Administrative  and  Other 

20, 007 

5.3 

TOTAL 

$380,000 

100.0 

TABLE  II 

NSIC  Costs  Using  IBM- 7090 


Operation 

Average  Cost 

Input 

$  1. 40/docuaent 

Indexed  Bibliography 

$50. OO/lssue 

SDI 

$  0.07/abstract/UBer 

Retrospective  Search 

$40. 00/single  search 
($25/quBry  In 
batches) 

TA3LE  III 


Aerospace  Research  Applications  Center  Monthly  Cost  Performance  Report 


Job 

Section 

Man 

No. 

Hours 

Base 

Cost 

Operations 

Overhead 

Total 

Cost 

Percent 
of  Job 

RS3342 

Engineer 

103 

8.00 

$40. 00 

$40. 00 

$80. 00 

92.8 

Clerical 

204 

.50 

.85 

.85 

1.70 

5.  1 

Service 

315 

.75 

2.59 

2.59 

5.  18 

2.  1 

JOB  TOTALS 

9.25 

$43. 44 

$43.  44 

$86.88 

100.0 

TABLE  IV 

Aerospace  Research  Applications  Center  Cost  Distribution  of  Average  Searches 


Cost  Item 

Betrospective 

SDl 

Direct  Labor 

$33.64 

$3.22 

Phone 

4.05 

- 

Supplies  and  Document  Reproduction 

1.83 

0.24 

Computer  Time 

27.  11 

1.38 

Operations  Overhead 

19.43 

2.48 

TOTAL 


$86. 06 


$7.32 


in 
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LISTED  BELOW  IS  A  SUMMARY  OF  THE  DOCUMENTS  SELECTED  FOR  YOU  BY  NSIC. 
PLEASE  CIRCLE  ONE  OF  THE  INTEREST  COOES  FOLLOWING  EACH  CARD  NUMBER. 
INTEREST  CODE  DEFINITIONS  ARE  - 

H  -  MUCH  imtJIESrf  S  o  idm  interest*  ti*  NO  INTERS*  >  . 


CARO 

V 

NUMBER 

V-' 

15533 

02 

16587 

05 

7-  - 


MSN 


INSTKl  t  TIONS 

1.  The  information  furnished  herewith  is  believed  to  be 
pertinent  to  your  present  interests.  However,  in  order 
to  serve  you  efficiently,  we  need  a  clear  indicatioit  of 
whether  or  not  this  is  true.  Please  acknowledge  by 
checking  the  appropriate  information  on  the  attached 
“User  Feedback  Card.”  Return  the  pre-addressed  card 
to  us  promptly  to  ensure  that  you  receive  additional 
abstracts  on  similar  subjects. 

2.  When  returning  the  card  enter  any  comments  you  may 
wish,  such  as  (1)  changes  in  fields  of  interest  (2) 
authors  of  interest  (3)  change  of  address,  etc. 

3.  All  documents  abstracted  on  these  cards  may  be 
examined  at  ORNL,  however,  the  Center  is  unable 
to  furnish  copies  of  any  of  the  documents  with  the 
exception  of  those  with  ORNL-NSIC  numbers. 
Available  information  on  document  sources  is  given 
on  the  line  following  the  abstract.  The  addresses 
of  these  source  organizations  are  available  from 
NSIC  on  request. 


Piece 

Stamp 

Hero 

Hetfuires  First  Clttss  Postafic 


NSIC 


Nuclear  Safety  Information  Center 
Oak  Ridge  National  Laboratory 
P.  O.  Box  Y 

Oak  Ridge,  Tennessee  37830 


Fig.  1 


SOI  abstract  card 
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NUCLEAR  SAFETY  INFORMATION  CENTER 
SDI  EVALUATION  CHECK  LIST 


Please  complete  and  return  this  form  to  NSIC. 
1.  I  review  the  SDI  abstracts 


Usually  □  Occasionally  □  Rarely 
2.  I  find  the  SDI  service  to  be 


’ 


Very  useful  □  Fairly  useful  □  Of  little  use 
3<  The  abstracts  are  in  general 


□ 

Too  detailed 

□ 

Insufficiently  detedled 

1  U*  About  right 

□ 

Too  long 

□ 

Too  short 

1  About  right 

□ 

Too  old 

□ 

Too  tentative 

1  About  right 

The 

abstract  cards 

are 

□  Retained  □  Discarded 

I  I  Filed  f  1  Circulated  to  friends 

5.  Compared  to  NSIC's  quarterly  Indexed  Bibliography,  I  find  that 

I  M  I  can  rely  on  the  SDI  service  alone 

a  The  SDI  provides  too  few  references 

6.  In  general  I  prefer 

{“vf  SDI  □  Bibliographies 

7.  The  frequency  of  SDI  mailings  is 

□  Too  often  □  Too  seldom  right 

8.  I  suggest  the  following  changes  in  the  SDI  program; 

_ 


Fig.  2  Ckiestionoalre 
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Fig. 3  Operating  cost  report 
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SUMMING-UP  OP  THE  SPECIALIST  MEETING 
Melvin  S.Day 

Acting  Assistant  Administrator  for  Technology  Utilization 
National  Aeronautics  and  Space  Administration 
Washington,  USA 


I  believe  that  all  of  us  have  been  impressed  by  the  dominant  theme  of  this  meeting:  practicality,  combined 
with  common  sense,  in  meeting  the  problems  of  mechanizing  an  information  center.  If  it  has  been  true  in  the 
past  that,  as  Mr  Isotta  aptly  indicated,  often  times  "a  program  of  mechanization  was  initiated  and  pursued 
simply  because  it  was  the  thing  to  do”,  this  is  no  longer  so.  Today  we  fully  realize  that  autom?* ion  is 

essential  and  must  be  accelerated,  but  we  are  also  conscious  of  the  associated  problems.  Many  of  these  problems 

have  been  discussed  at  this  meeting.  Among  them  are  the  continuous  advances  in  computer  capabilities,  sout  s 
of  input  to  the  automated  systems,  availability  of  full  text  of  the  original  documents,  selling  top  managemt 

on  the  need  for  a  computerized  system, difficulties  of  training  users  to  benefit  from  the  new  systai,.,  :nd  sy:  m 

management . 

Yesterday  morning  Mr  Jones  opened  our  meeting  with  a  down-to-earth  hard  hitting  approach  to  the  critical 
problem  of  obtaining  management  approval  of  the  proposal  to  mechanize.  His  experience  confirms  that  there  is 
no  substitute  for  painstaking  preparatory  work  and  a  well-presen„ed  briefing.  He  also  stressed  that  the  tei  is 
used  in  the  presentation  must  be  the  same  terms  that  are  used  by  management  in  its  evaluation  of  other  branches 
of  the  organization.  I  feel  that  this  is  a  particu  irly  important  point  with  respect  to  computer  appl  cations. 
Management  has  certainly  not  become  disenchanted  w..h  computer  operations  -  far  from  it  -  but  managemen  has 
become  more  concerned  with  the  proper  place  of  the  comp  , ter  in  the  organization.  It  has  become  famii:ar  with 
systems  analysis,  and  is  conscious  of  the  precautions  t.iat  must  be  taken  to  assure  operational  success. 

Therefore,  Mr  Jones’  advice  not  to  oversell,  and  to  be  ready  for  a  supplemental  study  to  cover  other  points 
that  management  wants,  is  particularly  appropriate. 

Mr  McCarn  reinforced  this  need  for  careful  planning  in  readying  an  organization  foi  automatior'  by  telling  a 
horror  story  of  a  system  failure  and  the  fortunately  happier  story  of  the  successful  development  of  a  MEDLARS 
system.  We  should  all  be  conscious  of  the  conflicts  that  will  develop  in  implementing  a  new  system  and  attempt 
to  resolve  as  many  as  possible  in  the  planning  stage.  A-s  Mr  McCarn  points  opt  there  may  be  realistic  objections 
to  the  proposed  new  systep  Probably  all  of  us  are  familiar  with  unjustified  enthusiasms  iui  uutoualed  systems 
that  prove  to  be  impractical  because  of  neglected  aspects  of  design  and  planning.  So  hero  a,„iin.  emphasis 
should  be  placed  on  design  and  planning. 

Specific  problems  in  transfer  to  computer  operations  were  represented  by  Mr  Amey’ s  paper  on  finding  the 
optimum  mix  of  staff  and  consultants  and  the  effect  of  computer  hardware  on  implementation  and  performance. 

Mr  Amey  noted  that  some  systems  characteristically  provide  services  that  are  computer -oriented  rather  than 
directed  toward  the  needs  of  the  ultimate  users.  I  am  sure  that  we  all  know  of  black  box  systems  with  input 
and  output  nut  adequately  fitted  to  human  users  and  difficult  to  expand  or  transfer  to  a  different  make  of 
computer.  Involving  your  internal  staff  heavily  in  the  design  of  the  system  is  difficult  but  desirable,  as 
Mr  Amey  implies.  Unless  your  staff  is  forceful  and  has  adequate  expertise  in  computer  capabilities,  yon  will 
be  amazed  at  the  power  of  the  computer  to  force  your  planning  Into  Its  limitations. 

Mr  Schuler's  paper  glve<,  many  practical  aspects  of  a  real  life  information  system  including  procurement  of 
computer  equipment,  and  recruitment  and  training  of  staff.  In  his  paper  he  also  illustrated  path  chart  approach. 

Mr  Dammers  forcefully  brought  one  of  our  difficulties  to  the  front:  computer  development  appears  at  first  :o 
outrun  our  capability  to  apply  1-  to  our  best  advantage.  Continuous  rapid  advances  In  computer  speed,  memory 
size,  and  peripheral  equipment,  combined  with  variables  of  delivery  dote,  .  ost  performance,  and  compatibility 
with  existing  equipment,  make  hardware  selection  a  compromise.  Nevertheless,  in  planning  ah«ad.  many  informa¬ 
tion  systems  may  expect  to  parallel  the  developments  planned  by  Mr  Dammers  for  his  own  system.  In  particular, 
on-line  mass  storage,  real-time  rapid  reaponae  query  systems,  and  visual  display  extended  to  many  access  points, 
appear  at  this  time  to  be  on  the  path  we  shall  almost  Inevitably  follow.  Direct  access  to  a  large  computer,  or 
use  of  a  satellite  computer  as  described  by  ilr  Dammers,  or  remote  turminal  connection  to  u  comowrclal  informa¬ 
tion  service  are  possible  system  alternatives. 

The  need  for  operators  of  small  information  centers  to  undersc.ind  systems  design,  even  if  they  are  dependent 
on  larger  centers,  was  presented  by  dr  Bree.  In  particular,  he  stressed  tl  '  need  for  a  controlled  vocubulary; 
that  la.  a  thesaurus.  This  too  seems  to  be  a  firm  trend.  With  apologies  to  Mr  Daoiaers.  I  say  that  I  feel  the 
path  to  the  use  of  a  completely  free  vocabulary  does  not  appear  likely  to  bo  well  traveled.  So  we  .shall  have  to 
develop  ways  of  permitting  the  use  of  an  information  system  to  use  a  thesaurus  conveniently.  Mr  Bree  has 
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described  the  graphical  form  in  which  the  EURATOH  Theaaurua  is  presented.  Here  again  direct  access,  remote- 
terainal  computer  systems  could  permit  thesaurus  terms  to  be  directly  displayed  on  a  cathode  ray  screen.  The 
user  can  then  browse  through  the  thesaurus  while  setting  up  his  search  query.  He  is  also  informed  of  the  numbe" 
of  documents  that  would  result  from  any  stage  of  his  search  before  a  display  of  the  citations  is  requested  by 
the  browser. 

The  user’s  ability  to  formulate  his  own  search  may  change  the  present  pattern  in  which  a  documentallst  acts 
as  Intermediary  between  the  scientist  and  the  system.  Hr  Vemimb  discussed  the  problem  of  the  scientist  who 
attempts  to  use  an  information  system  by  a  single-term  approach  and  described  a  successful  attempt  to  get  more 
specific  Inq-'irles  for  a  "batch"  type  processing  system.  Here  again,  the  remote  terminal  computer  system  could 
provide  the  "instant  feedback"  of  which  Hr  Vemimb  speaks 

Besides  the  technical  developments  in  information  science  and  in  computer  technology  which  we  must  consider, 
costs  are  becoming  everyone’ s  concern.  As  we  are  all  aware,  today’ s  research  and  development  programs  and  the 
information  services  to  support  them  exist  in  an  atmosphere  of  stringent  economy.  All  budgets  are  undergoing 
close  scrutiny.  Because  of  the  expense  of  computer  operations,  management  will  insist  on  meaningful  cost  and 
effectiveness  data.  In  his  paper  on  evaluation  and  cost  analysis  of  automated  information  analysis  center 
operations,  Mr  Buchanan  has  shown  how  these  data  can  be  collected.  He  has  stressed  that  the  essential  ingredients 
are  to  plan  early  for  data  collection,  and  to  design  a  system  that  allows  for  easy  interpretation  of  results. 

To  turn  from  the  computer  aspect  of  automation,  an  essential  ingredient  of  an  information  system  is  the  provision 
of  the  full  text  of  desired  documents.  If  these  have  been  located  by  fast  covuterized  search,  the  user  will 
also  expect  to  receive  the  document  quickly,  as  Hr  Amey  emphasized.  This  presents  acquisition  problems  to  the 
information  center.  Should  complete  sets  of  documents  be  purchased,  or  should  only  those  in  certain  categories 
be  ordered?  If  the  latter,  individual  documents  not  in  these  categories  sill  have  to  be  ordered  at  increased 
unit  cost  and  some  delay. 

Furthermore,  a  significant  trend  in  the  US  affecting  costs  of  information  is  the  termination  by  several  large 
US  Government  agencies  of  free  distribution  of  documents  to  their  own  contractors,  universities,  and  other 
agencies.  Last  year,  the  Defense  Documentation  Center  began  to  charge  its  users  for  its  unclassified  documents, 
and  this  year  the  Atomic  Energy  Commissiou  end  NASA  have  followed  suit  in  Introducing  user  charges  for  many  of 
their  information  products.  Information  centers  will  therefore  have  to  consider  the  effects  of  these  charges 
and  provide  for  them  in  their  document  acquisition  budgets.  This  will  probably  lead  to  a  greater  emphasis  on 
the  use  of  the  less  expensive  nicrc'fiche.  While  microfiche  are  inexpensive  in  themselves,  the  information 
center  will  have  to  consider  the  costs  of  readers  and  printers,  and  possibly  microfiche  reproducers.  An  optimum 
distribution  of  costs  in  acquiring  the  various  equipment  should  be  determined  on  the  basis  of  real  user  needs. 
Before  closing,  and  with  your  permission  I  would  like  to  draw  upon  ay  own  NASA  experience  with  our  aerospace 
information  for  some  final  comments.  Although  the  NASA  scientific  and  technical  Information  system  must  be 
considered  large  by  any  standard,  the  problems  encountered  in  automation  and  the  trends  that  have  developed  are 
applicable,  in  my  opinion,  to  any  sized  information  operation.  Hr  Isotta  described  iu  an  excellent  paper  the 
adaptation  of  this  system  to  a  European  environment. 

In  marjr  cases,  our  experiences  have  exactly  paralleled  those  described  at  this  meeting.  In  coaputer  opera¬ 
tions.  we  began  with  an  IBH  1401  in  1962,  and  replaced  it  with  a  1410  less  than  two  years  liter.  In  1966,  an 
IBM  360  Hodel  40  was  installed,  last  year  an  IBM  36050  was  added,  and  we  are  Just  now  phasing  out  Autocoder 
programs  that  have  been  run  in  emulator  mode.  This  is  a  good  example  of  the  impact  of  a  particular  piece  of 
hardware  configuration  that  Hr  Daamera  mentioned  this  morning. 

We  very  early  made  plans  to  avoid  being  limited  by  software:  that  is.  to  get  away  from  the  problem  of  re¬ 
writing  every  complicated  computer  program  whenever  new  equipment  becomes  available.  A  high-level  programming 
languag'',  PL-1,  was  selected,  and  almost  all  our  programs  are  written  in  this.  Our  publication  system  is  table 
driven,  so  that  reformatting  a  print  program,  for  example,  ia  greatly  facilitated. 

For  our  indexing  and  sear.-h  programs,  we  took  the  path  of  a  controlled  vocabulary  and  prepared  a  NASA 
Thesaurus.  This  is  comrutible  with  the  LEX  Thesaurus  mentioned  by  Hr  Schuler  and  is  consistent  with  Mr  Bree’s 
conviction  for  the  need  of  a  controlled  vocabulary. 

Computer  printing  has  been  avoided  in  favor  of  photocomposition  wherever  possible.  Our  abstract  Journal 
STM  (Scirntt/ic  and  Technical  Arroipace  Reports)  is  piepared  by  a  combination  of  photocomposition  methods. 

The  abstract  section  is  composed  on  computer-tape-driven  Photon  equipment,  while  the  indexes  are  set  up  on  the 
coBputcr-driven  Llnotron. 

Current  awareness  service  is  provided  to  NASA  Centers  and  contractors.  Initially,  an  SOI  progrM  using 
Individually  tailored  interest  profiles  was  developed.  We  operated  this  eystem  for  6  .vears.  At  one  time 
there  were  about  a  thousand  individuals  participating  in  our  SOI  program.  In  view  of  the  availability  of  an 
alternative  current  awareness  system  known  as  SCAN  (Selected  Current  Aerospace  Notices),  9)1  has  been  terminated. 
SCAN  provides  computer-selected  notifications  under  186  subject  topics.  Because  the  single  computer-printed 
list  in,:  is  reproduced  by  low  cost  offset  printing.  SCAN  cost  per  user  gpea  down  with  increasing  numbers  of 
participants,  typically  being  one-firih  to  one-tenth  the  cost  per  user  of  SOI.  We  now  have  almost  9(X)0 
Individuals  receiving  one  or  more  SCAN  notification  each  month.  Vuu  may  recall  that  the  success  of  this  system 
111  tne  US  has  been  duplicated  by  ESRO’ s  success  in  Europe.  Mr  Isotta  mentioned  ESRO’s  corresponding  successful 
Standard  Profile  Service. 
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NASA’s  RECON,  short  for  REhiote  CONsole.  Is  the  program  ahich  above  all,  we  believe  represents  the  path  of 
the  future  for  infoniiation  centers  and  users.  Although  it  is  still  in  the  early  stages  of  installation,  we 
shall  have  CRT  display  terminals  in  all  our  major  NASA  research  centers  by  November.  The  RECON  user  will  first 
see  appropriate  sections  of  the  NASA  Thesaurus  displayed.  He  can  then  formulate  his  search  by  inserting  Boolean 
relations  between  Thesaurus  terms,  and  be  informed  at  each  step  of  the  number  of  documents  citations  that  the 
search  would  reveal.  Bibliographic  citations  of  the  selected  documents  are  then  displayed  or  printed  out  as 
the  user  wishes. 

Besides  RECON  use  in  retrospective  searches,  we  plan  to  have  a  current  awareness  capability  operational  next 
year.  To  see  citations  to  documents  that  have  entered  the  system  since  the  user's  last  contact  with  RECON,  he 
will  need  only  identify  himself,  and  the  citations  selected  by  his  personal  SDI  Interest  profile  or  by  desired 
SCAN  subject  topics  will  be  displayed.  RECON  is  representative  of  the  man-'  direct  access  information  systems 
that  will  be  available  to  numerous  information  centers  in  the  future,  eit.ier  through  in-house  operation  or 
through  terminals  connected  to  commercial  systems. 

Ur  Chairman,  I  am  delighted  to  have  been  able  to  attend  these  informative  sessions.  By  sharing  our  experi¬ 
ences  as  we  have  done  here,  I  believe  that  we  are  helping  to  chart  out  the  course  that  developments  in  informa¬ 
tion  science  and  technology  will  take,  over  the  coming  years.  The  papers  presented  at  this  meeting  are  first 
class.  In  themselves  they  are  a  meaningful  contribution  to  the  state-of-the-art  literature.  I  salute  each  of 
the  speakers  and  to  each  of  them  I  express  both  my  admiration  and  mv  thanks. 


ADDRESS  OF  APPRECIATION 


G.H.Tidy 

Defence  Research  Board.  Ottawa,  Canada 
AGARO  National  Delegate 


It  gires  me  great  pleasure  to  express  for  Canada  our  appreciation  for  being  given  the  privilege  of  holding 
this  Specialist  Meeting  on  “The  Mechanization  of  Saall  Information  Centers”  here  in  Ottawa.  Proa  the  papers  I 
have  heard  during  this  meeting,  I  am  encouraged  to  believe  that  substantial  progress  can  and  will  be  made  toward 
increased  efficiency  and  sophistication  of  small  information  systems  at  reasonable  cost. 

I  am  particularly  encouraged  by  the  way  that  our  librarians,  accustomed  in  the  past  to  working  in  the  quiet 
atmosphere  of  booklined  libraries,  have  not  hesitated  to  adapt  to  the  computer  age,  in  spite  of  the  possible 
disruption  of  the  traditional  quiet  of  their  sanctum  by  the  noisy  clatter  of  the  ancillary  equipment!  One 
could,  of  course,  also  interpret  the  union  of  automation  with  information  handling  as  being  initiated  by 
aggressive  cooiputer  specialists! 

However  the  union  may  have  taken  place,  there  is  no  doubt  that  it  can  be  most  fruitful  in  improving  our 
ability  to  keep  pace  with  the  ever  increasing  flood  of  technical  iniuraation.  It  is  most  important  for  our 
technological  future  that  the  output  of  scientific  and  engineering  knowledge  so  necessary  for  progress  be 
retrievable  selectively  and  quickly. 

This  conference  has  indicated  that  many  problems  remain  to  be  solved  but  I  am  convinced  that  with  the  skills 
ai.J  energy  being  devoted  by  you.  substantial  progress  will  continue.  I  hope  that  the  conference  has  assisted 
in  this. 

In  closing  1  wish  to  express  my  appreciation  to  the  Executive  Committee  of  the  Panel  for  accepting  Canada's 
invitation,  and  1  thank  particularly  the  speakers  and  the  behind-the-scenes  workers  who  have  contributed  to 
much  to  the  success  of  the  meeting. 
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DISCUSSIONS 

The  discussions  which  followed  the  presentatio'i  of  the 
papers  were  kindly  compiled  from  the  tape  recording  by 
Mr  J.J. Irvine  from  the  P  ance  Research  Board,  Ottawa. 


PAPER  No.  1  -  Mr  A. C. Jones 

Mr  Buchanan,  USA;  Why  is  it  so  important  to  get  the  management  to  realize  the  complexity  of  your  information 
work? 

Mr  A. C. Jones:  There  are  two  reasons.  One  is  that  the  great  advantage  of  computers  is  their  ability  to  solve 
problems  that  cannot  be  handled  readily  in  any  other  way.  Therefore,  if  you  cannot  demonstrate  that  your  pre¬ 
sent  system  is  fairly  complex,  there  is  not  much  hope  of  getting  approval  to  change  it. 

The  main  reason  is  that  the  complexity  of  the  system  determines  the  quality  of  the  people  you  are  allowed  to 
employ. 

Dr  Vernimb,  Germany:  You  referred  to  the  need  to  prepare  quantitative  data  about  your  present  system.  Is  this 
not  expensive  to  obtain? 

Mr  A. C. Jones:  Yes  indeed.  In  a  manual  system  they  are  expensive.  If  people  are  gathering  statistics,  they 
cannot  be  doing  their  usual  jobs.  But,  if  you  don’t  get  the  statistics,  there  isn't  much  hope  of  demonstrating 
the  need  for  the  computer. 

Mr  McCarn,  USA:  It  seemed  to  me  from  your  description  that  most  of  the  motivations  you  were  appealing  to  in 
management  were  concerned  with  inprovements  in  your  organization  and  the  service  it  could  provide.  Do  you  not 
also  appeal  to  other  motives  such  as  their  own  esteem  as  managers  of  the  system  or  to  nationalistic  aspirations? 
Could  you  comment  on  other  motives? 

Mr  A, C. Jones:  Yes,  I  think  both  of  the  ones  you  have  suggested  are  real  and  significant.  Management  is  obviously 
desirous  of  seeing  every  part  of  its  organization  improved.  It  is  always  nice  to  feel  that  you  are  keeping  as 
up-to-date  as  possible  within  your  resources.  Possibly  the  greatest  of  the  secondary  motives  is  the  hope  that 
the  new  system  will  result  in  a  body  of  satisfied  customers. 

Mr  McBumey.  Canada;  You  will  recognize  this  as  a  dirty  question  and  I  do  not  really  expect  an  answer.  In  all 
levels  of  the  government  there  is  pressure  to  measure  the  cost -benefit  ratio  of  services.  This  is  probably  more 
difficult  to  do  in  defence  work  than  in  the  civilian  sector,  but  do  you  have  any  magic  method  of  measuring  the 
benefits  to  your  users  ol  your  services? 

Mr  A.C. Jones;  I  am  glad  that  you  said  that  you  didn’t  expect  an  answer.  We  collect  letters  of  appreciation, 
but  have  as  yet  developed  no  quantitative  measurements.  Is  there  anyone  in  the  audience  who  would  care  to 
comment  on  this  problem? 

Dr  Wooster,  USA:  The  technique  of  collecting  testimonials  on  what  is  sometimes  called  a  Gabriel  file  is  quite 
widespread.  I  have  recently  done  an  evaluation  for  the  US  Committee  on  Scientific  and  Technical  Information  of 
the  literature  on  measuring  the  effectiveness  of  information  analysis  centers.  The  evaluation  will  be  published 
in  American  Documentation  in  the  near  future.  The  conclusion  was  that  there  is  no  satisfactory  standard  of 
measurement. 

Dr  Campbell,  Canada;  In  preforming  your  study  and  presentation  to  management,  how  much  user  participation  did 
you  require  and  encourage? 

Mr  A.C.Jones;  If  you  mean  user  participation  in  developing  the  proposal  and  presenting  it,  the  answer  is  very 
little,  possibly  because  of  the  lack  of  users  in  close  proximity.  What  I  personally  would  have  liked  to  do 
would  have  been  to  encourage  direct  contact  between  the  users  and  management.  For  the  future,  we  have  estab¬ 
lished  a  steering  conmittee  on  which  the  users  are  heavily  represented  and  from  which  we  hope  to  get  useful 
guidance. 
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PAPER  No.  2  -  Mr  S.  C.Schuler 

Mr  Morgan,  Canada;  Mention  was  made  In  a  slide  of  the  provision  of  means  of  eliminating  documents  of  low 
scientific  value.  Could  you  explain  the  criteria  used  in  this  selection  and  who  does  it?  Does  the  user  have 
an  input  in  this?  Also,  what  percentage  are  discarded? 

Mr  S.C.Schuler;  The  user  doesn’t  have  much  to  say  about  this  directly.  The  selection  is  made  by  the  subject 
specialists  on  the  basis  of  their  experience  of  what  is  useful.  It  should  be  emphasized  that  some  material  in 
our  collection  does  not  receive  the  full  treatment,  ’’or  instance,  in  our  journal  we  have  a  section  that  contains 
subject  listed  titles  only. 

Miss  Marriott,  Canada;  What  kind  of  people  do  the  editing  of  your  tapes?  Are  they  clerical  or  professional? 

Mr  S.C.Schuler;  The  checking  of  the  tape  is  done  by  the  supervisor  of  clerical  staff,  but  the  technical  content 
is  checked  by  an  editor  before  it  gets  on  tape. 

Mr  Gillan,  Canada;  You  made  mention  of  dedicated  positions  on  the  paper  tape.  Will  this  cause  problems  in  the 
choice  of  number  of  tracks  in  computing  equipment  later  on^ 

Mr  S.C.Schuler;  We  are  using  seven  track  tape  and  the  size  of  the  file  we  will  have  built  up  by  the  date  of 

installation  of  an  in -house, computer  will  make  it  difficult  to  change  to  another  standard. 

Mr  Atkins,  Canada;  You  mentioned  problems  of  legibility  of  computer  output.  Have  you  made  arrangements  to  check 
this  quality  by  your  organizatioti  prior  to  press  run? 

Mr  S.C.Schuler;  By  liaison  between  our  organization,  the  computer  operators,  and  the  printer,  most  of  these 
problems  have  been  eliminated  and  we  are  now  satisfied  with  the  output. 

Mr  Jones,  Canada;  Could  you  explain  the  reasons  for  your  plans  to  move  from  a  service  bureau  computer  to  an 

in-house  computer? 

Mr  S.C.Schuler;  The  HMSO  computer  is  presently  used  by  many  other  organizations  and  it  will  not  have  capacity 
for  other  operations  which  we  will  wish  to  add  in  the  future. 

Mr  Day.  DSA;  Could  you  tell  us  more  about  the  Tech  Link  Service?  How  many  users  do  you  have  and  what  use  do 
they  make  of  the  Tech  Links? 

Mr  S.C.Schuler;  We  currently  have  about  4700  users  in  industry.  This  service  is  not  advertised,  but  rather  is 
distributed  through  nine  regional  offices.  Each  regional  office  is  managed  by  a  research  scientist  and  is 
responsible  for  collecting  the  area’s  requirement  for  Tech  Links.  The  user  population  is  growing  at  about  sixty 
per  month  and  about  five  new  Tech  Link  items  are  prepared  each  week. 

We  have  no  way  as  yet  of  quantifying  the  utilization  of  the  Tech  Links.  One  notable  success  was  signalled 
by  the  request  for  '500  copies  of  an  item  on  optimum  routing  of  delivery  vans. 

Dr  Wooster,  USA;  Have  you  thought  of  changing  from  a  loan  service  to  a  system  of  giving  away  or  selling  reports? 

Mr  S.C.Schuler;  We  do  sell  reports  listed  in  Tech  Links.  The  loan  service  of  other  reports  is  presently 
included  in  the  subscription  price  of  the  announcement  journal.  Plans  are  being  made  to  charge  directly  for 
the  loan  service  of  paper  documents  in  1970.  We  are  actively  encouraging  the  use  of  microfiche,  but  their 
widespread  adoption  is  dependent  in  the  availability  of  better  and  cheaper  readers. 


PAPER  No.  3  -  Mr  N.E.C.  Isotta 

Atkins,  Canada;  In  your  preparation  for  information  service  in  the  field  of  electronic  components,  did  you 
distinguish  between  state-of-the-art  and  state-of-the-market? 

Mr  N.E.C. Isotta;  Yes.  There  is  greater  emphasis  on  state-of-the-market  because  even  the  designers  of  future 
spacecraft  are  reluctant  to  specify  components  that  are  not  presently  available. 

Dr  Brown,  Canada;  I  presume  your  services  are  limited  to  ESRO  member  states.  I  an  also  curious  about  the 
division  of  use  of  your  services  between  ESRO  establishments  and  outside  organizations. 

Mr  N.E.C. Isotta;  ’Th"  service  is  limited  to  ESRO  countries.  It  was  originally  set  up  for  ESRO  staff,  currently 
comprising  about  12,.,  people  scattered  throughouu  the  member  countries.  At  the  moment  about  thirty  percent  of 
reutilization  of  the  service  is  by  staff  members.  However,  many  of  the  outside  users  are  in  institutions  who 
are  developing  experiments  for  the  space  craft.  In  this  sense,  these  institutions  are  virtually  considered  as 
ESRO  establishments  and  get  the  same  information  service. 


Mr  McGee,  Canada;  I  am  intrigued  by  your  customer  liaison  group.  Can  you  sav  something  about  their  opinions 
of  the  descriptor  problem  of  picking  the  right  word  to  retrieve  the  right  document? 

Mr  N.E.C. Isotta;  Of  course  there  is  a  big  problem  and  it  Is  probably  worse  in  Europe  because  of  language  diffi¬ 
culties.  Retrieval  calls  for  considerable  familiarity  with  the  thesaurus  and  I  tend  to  think  that  the  people 
who  are  retrieving  should  also  have  experience  in  indexing  the  documents.  Secondly,  you  cannot  expect  these 
people  to  have  expertise  in  a  wide  range  of  subjects.  They  have  to  make  the  best  selection  of  terms  they  can, 
from  a  fairly  narrow  speciality  base  by  comparison  with  the  coverage  of  the  NASA  system. 

Another  difficulty  is  inherent  in  the  indexing  philosophy  on  which  the  thesaurus  is  based.  We  index  to  the 
most  specific  term  and  this  entails  a  careful  search  of  related  thesaurus  terms  whan  a  broad-based  search  is 
undertaken. 

A  point  that  should  be  made  is  that  the  situation  is  vastly  changed  with  the  introduction  of  NASA’ s  RECON. 
Here,  the  interaction  between  user  and  computer  greatly  facilitates  the  formulation  of  the  search. 

Dr  Cherrington,  Canada:  How  much  noise  will  the  user  tolerate  in  the  information  system? 

Mr  N.E.C. Isotta:  In  the  case  of  SOI,  I  would  say  up  to  one  hundred  percent  which  may  be  a  controversial  state¬ 

ment.  In  a  data  ^'•'se  of  one  thousand,  the  user  might  well  be  willing  to  pay  for  twenty  announcements  per  month 
when  only  ten  are  relevant.  In  a  larger  data  base  this  percentage  would  not  of  course  be  tolerable. 

Mr  Damraers,  UK:  Could  you  give  us  data  on  the  cost  of  your  information  service  in  ESRO? 

Mr  N.E.C. Isotta;  It  is  about  one  snd  one-half  percent  of  the  ESRO  budget  which  is  in  line  with  accepted 

standards . 

Mr  Willis,  USA:  Would  you  give  us  some  idea  of  the  number  of  your  staff  in  t;ie  information  center  in  Paris  and 
in  the  computer  center  in  Germany? 

Mr  N.E.C.  Isotta:  This  is  ratl.jr  difficult  because  our  work  is  only  part  of  the  load  on  the  computer.  We  have 
about  one  and  one-half  system  engineers  and  a  documentalist  in  Germany  together  with  one  system  engineer  in 
Paris.  In  addition  there  are  a  further  twenty-two  staff  based  in  Paris. 


PAPER  No.  4  -  Mr  D.B.McCarn 

Mr  Hinckley,  UK;  Do  you  have  any  other  concrete  suggestions  to  system  developers  to  obviate  this  hostility 
from  staff  and  management? 

Mr  D.B.HcCarn;  Part  of  the  answer  is  in  the  attitude  of  the  computer  people.  If  they  think  of  themselves  in 
the  Messianic  role  of  solving  other  people’s  problems  by  a  solution  imposed  from  on  top,  then  almost  certainly 
there  is  going  to  be  trouble.  If  they  see  their  roles  as  co-operating  in  the  development  of  a  system,  they  are 
much  more  likely  to  have  a  successful  development. 

Dr  Oiristie,  Canada;  Can  you  pinpoint  any  reason  for  the  lack  of  information  on  the  problems  of  selling  an 
automated  system  to  management? 

Mr  D.B.McCarn:  The  automation  people  are  more  interested  in  the  technical  problems  of  development  than  in  human 
problems.  They  tend  to  be  concrete-minded  rather  than  being  interested  in  people. 

Mr  Dammers,  UK:  You  said  that  a  stable  organization  opposes  innovation.  How  about  a  system  that  is  growing? 

Mr  D.B.McCarn:  If  a  growing  system  can  see  a  possibility  of  handling  the  increasing  load,  then  you  will  have 
difficulty  in  automating  the  system.  If  the  organization  cannot  handle  a  growing  work  load,  it  is  unstable. 


PAPER  No.  5  -  Dr  G.X.Amey 

Dr  Wooster,  USA:  When  you  mention  consultants  in  your  paper ,  are  you  referring  to  your  contractors? 

Dr  G.  X.  Amey:  Yes. 

Dr  Wooster,  USA:  What  is  your  opinion  of  the  C06ATI  subject  headings  for  classification  of  reports? 

Dr  G.X.Amey:  There  are  difficulties  in  its  use  but  it  is  probably  as  good  as  any  other  classification.  Most 
classification  systems  are  essentially  symbolic  so  if  one  is  consistent  in  its  use,  the  choice  of  system  doesn’t 
make  too  much  difference.  We  also  use  the  TEST  Thesaurus,  but  our  impression  is  that  it  is  gaining  wide  accept¬ 
ance  except  in  the  US  DoD  which  was  the  developer. 

Dr  Vernimb,  Germany:  Is  it  really  necessary  to  develop  your  own  system?  Are  there  not  systems  available  which 
could  be  used? 
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Dr  G. X.  Aney;  Perhaps  this  will  be  possible  in  the  future,  but  at  present  there  is  a  lack  of  standardization  in 
computers  and  software.  There  is  a  concept  of  software  components  which  might  be  available  in  the  future,  but 
if  you  want  a  system  now,  it  is  necessary  to  build  your  own. 


PAPER  No.  6  -  Mr  H.F. Damme rs 

Dr  Wooster,  USA:  Do  you  plan  to  Install  graphic  terminals  in  your  system  as  well  as  the  present  teletype 
terminals? 

Mr  H.F.Dammers:  We  are  using  CRT  terminals  now  mainly  as  a  means  of  dispensing  with  multiple  remote  card 
indexes.  As  for  light  pens  and  reactive  graphic  terminals,  the  problem  is  one  of  cost  and  we  have  no  ionediate 
plans  to  Install  any. 

Mr  Booth,  Canada;  I  am  interested  in  your  card  system.  It  seems  to  be  somewhat  like  the  Termatrex  systems 
which  are  familiar  on  this  continent.  These  are  often  abandoned  in  favour  of  computer  systems  when  financially 
feasible,  but  you  run  both  systems  in  parallel.  Is  this  to  provide  access  when  remote  terminals  are  not 
available? 

Mr  H.F.Dammers:  Yes,  exactly.  The  card  systems  are  an  extremely  convenient  way  of  providing  access  to  the 
storage  when  remote  terminals  cannot  be  provided  for  economic  or  hardware  reasons. 

Mr  Bree,  Germany:  There  is  clearly  a  trend  towards  large  input  processing  centers  which  would  provide  a  service 
to  Taller  information  centers.  There  are  two  possible  means  of  co-operation  between  the  two  types  of  centers, 
direct  on-line  connection  or  independent  operation  of  the  smaller  centers  using  magnetic  tape  material  supplied 
by  the  input  centers.  Could  you  comment  on  the  choice  between  these  modes  of  operation? 

Mr  H.F.Dammers:  My  philosophy  is  to  avoid  doing  anything  that  is  available  elsewhere  in  a  cheaper  or  better 
form.  Our  center  has  an  obligation  to  process  data  produced  by  our  company,  but  we  see  no  reason  to  handle 
published  literature.  We  will  gladly  take  whatever  is  offered  by  Chemical  Abstracts  and  other  similar  services. 
This  holds  true  for  companies  and  I  think  will  be  also  true  for  National  organizations. 

Miss  Evans,  Canada;  Can  you  give  us  figures  on  the  proportion  of  equipment  cost  to  system  cost? 

Mr  H.F.Dammers;  In  our  case,  it  is  about  thirty  percent  which  is  higher  than  usual.  I  think  a  more  comnon 
figure  would  be  twenty  percent. 

Dr  Araey,  Canada;  Could  you  say  something  about  budgeting  and  staffing  problems  in  your  evolutionary  system? 

Did  you  hire  supplementary  staff  in  the  conversion  period  or  get  additional  funds? 

Mr  H. F. Dajiraers:  Any  .increases  were  as  a  result  of  the  expanding  flow  of  information  and  not  specifically  for 
mechanization.  We  have  a  continuing  policy  of  allotting  twenty-five  percent  of  available  effort  to  development. 
You  might  ask  how  this  can  be  done  in  a  busy  library  where  there  is  no  money  or  effort  available  for  mechaniza¬ 
tion.  Well,  information  is  a  flexible  business  and  usually  money  can  be  found  by  slight  reductions  in  purchases 
or  services. 

Our  fraction  of  the  research  budget  has  declined  from  three  percent  in  1962  to  two  percent  in  1969. 

Mr  Willis,  USA:  How  do  you  estimate  the  useful  life  of  your  equipoent? 

Mr  H.F.Dammers:  This  is  difficult  because  of  the  rapid  developments  in  the  field  and  the  long  lead  time  in 
procurements.  The  problem  is  to  decide  whether  to  buy  or  rent  equipment.  If  one  keeps  a  computer  for  five 
years  it  is  cheaper  to  buy,  but  perhaps  the  computer  will  no  longer  be  suitable  at  the  time. 

Perhaps  the  best  plan  is  to  buy  equipmeni,  that  can  be  integrated  with  future  purchases.  For  instance,  our 
present  computer  will  become  a  slave  unit  for  the  next  model  purchased. 

Mr  Morgan,  Canada:  Does  the  Information  service’ s  two  percent  share  of  the  research  budget  include  computer 
and  programming  costs? 

Mr  H.F.Dammers:  The  budget  figure  includes  computer  time  and  the  development  of  the  programs. 


PAPER  No. 7  -  Mr  R.Bree 

Mr  McGee,  Canada;  I  run  a  small  information  system  and  most  of  my  decisions  on  policy  have  been  the  opposite 
of  yours.  Do  you  think  that  larger  centers  are  mission-oriented  or  function -based  while  smaller  centers  are 
sub.j  ect -based? 

Mr  R.Bree'  I  presume  that  your  reference  to  a  small  center  is  to  one  that  has  a  limited  subject  field.  In 
that  case  the  subject  cataloguing  can  be  quite  detailed  while  in  a  larger  mission-oriented  system  the  subject 
coverage  is  necessarily  more  superficial.  The  decisions  on  policy  are  somewhat  different  for  the  two  cases. 
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Dr  Wooster,  ISA:  A  comment  first.  There  are  two  manufacturers  providing  equipment  to  store  and  retrieve  mli  -o- 
fiche  under  computer  control. 

My  question  has  to  do  with  the  meaning  of  weighting  as  used  in  your  paper  when  referring  to  search  techniques. 
What  do  you  mean  by  the  term  "weighting”? 

Mr  R. Bree;  It  means  printing  of  the  citations  of  most  likely  Interest  at  the  beginning  of  the  retrieval  list. 


PAPER  No.  8  -  Dr  J.E. Brown 

Mr  Laval  DuBeuil,  Canada;  Do  you  intend  to  run  retrospective  searches  and  if  so  when? 

Dr  J.E. Brown:  Yes  and  no.  The  tape  services  haven’t  been  going  long  enough  to  provide  experience  on  retro¬ 
spective  searching  but  we  are  prepared  to  extend  our  service  from  current  awareness  to  searching  when  the  demand 
is  sufficient.  One  important  point  in  current  awareness  service  that  we  recognized  was  the  necessity  of  ensuring 
that  we  held  all  journals  that  the  tape  services  referenced.  We  can  provide  photocopies  of  any  articles  to  which 
the  customer  may  not  otherwise  have  access.  A  charge  is  made  for  photocopies,  but  the  journal  may  be  borrowed 
on  inter-library  loan. 

Mr  Dale,  UK:  D<es  your  flat  charge  of  one  hundred  dollars  apply  to  all  your  customers  and  what  do  they  get 
for  it? 

Dr  J.E. Brown;  The  one  hundred  dollars  is  a  flat  rate  which  theoretically  enables  the  customer  to  use  all  three 
tape  services  to  which  we  subscribe.  In  practical  experience,  most  customers  fino  that  just  one  of  the  tape 
services  provides  an  adequate  coverage  in  his  field  of  interest.  The  charge  covers  the  development  of  a  profile 
of  up  to  sixty  terms.  There  is  an  increased  charge  for  more  than  sixty  terms. 

One  other  point  about  the  tape  services  is  that  they  are  prepared  from  advanced  copies  of  the  journal  articles 
so  we  sometimes  have  the  embarrassment  of  announcing  the  article  in  current  awareness  before  the  journal  is 
available. 

Mr  Dagger,  Canada;  Do  you  find  that  your  inter-library  loan  service  is  impeded  because  of  incomplete  information 
in  the  requests? 

Dr  J.E. Brown:  Yes.  We  have  done  a  study  that  showed  that  sixty  percent  of  the  time  spent  on  this  service  was 
due  to  inadequate  or  ambiguous  bibliographic  details  on  the  requests. 

Mr  Dagger,  Canada:  What  percentage  of  customers  are  satisfied  with  the  relevance  of  the  current  awareness 
service? 

Dr  J.E. Brown:  There  is  a  tremendous  variation  in  opinions  about  importance  of  relevance.  Some  scientists  are 
content  with  twenty  percent  and  others  expect  and  profess  eighty  percent.  There  is  difficulty  in  getting  the 
customers  to  keep  their  profiles  up  to  date. 


PAPER  No.  9  -  Mr  J.H.Klopp 

(In  the  absence  of  Mr  Klopp,  his  paper  was  read  by  Mr  Stolk.  He  suggested  that  questions  should  be  written  out 
and  mailed  to  the  author.) 

Mr  Dammers,  UK:  Unless  Mr  Klopp  had  an  enormous  system  to  develop  and  set  up,  which  wasn’ t  quite  apparent  from 
the  task  which  he  outlined.  I  wonder  how  he  could  afford  so  much  pre-training?  I  am  not  quite  clear  whether 
he  is  reporting  or  proposing. 

Mr  Stolk  (Partly  inaudible);  From  what  I  understand,  only  part  of  this  was  actually  done  so  I  think  that  the 
paper  was  a  picture  of  how  it  should  be  done  according  to  him. 


PAPER  No.  ID  -  Dr  Vernirab 

Mr  Isotta,  ESRO:  This  is  not  so  much  a  question  as  a  comment.  I  would  like  to  say  how  much  I  agree  with  the 
speaker’s  evaluation  as  a  most  desirable  one  for  an  interactive  operation.  I  think  it  is  worth  mentioning  that 
the  NASA  RECCN  does  almost  exactly  what  he  has  described. 

Dr  Vernimb;  1  agree. 

Mr  Dammers,  > .(;  The  difficulties  which  Dr  Vernimb  indicated,  when  a  user  tries  to  query  a  system  using  a 
specified  indexing  language,  arc  to  be  expected.  If  one  translates  the  text  via  a  special  indexing  language, 
the  user  gets  into  difficulties  and  another  complicated  system  must  be  added.  Would  it  not  have  been  easier 
to  forget  the  indexing  and  try  to  live  with  free  language? 
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Dr  V<*rni«b:  This  is  certainly  a  ;-isslbllity  and  there  are  systems  wnich  compare  the  text  of  the  queries  with 
the  text  stored  in  the  system.  But  in  my  opinion  we  have  to  u.se  a  structured  thesaurus  or  vocabulary  in  order 
to  get  an  acceptable  recall  ratio  and  because  it  is  a  cheaper  system.  It  is  partly  a  question  of  economics. 

Mr  Dammers,  lih:  I  do  not  think  that  there  is  any  proof  that  a  system  based  on  indexing  achieves  a  better  recall 
ratio  than  one  using  free  language.  On  the  contrary,  whatever  trials  have  been  done  have  shown  only  marginal 
differences. 

With  regard  to  costs,  I  would  like  to  know  if  yqu  have  specific  information  on  which  to  choose  one  system 
over  the  other. 

Dr  Vernimb;  In  a  free  language  system,  much  computer  time  is  needed,  whereas  in  a  vocabulary  system,  compara¬ 
tively  little  computer  time  is  required.  This  is  the  reasri  we  have  not  shifted  over. 

Dr  Mclvor,  Canada;  In  our  experience  with  chemical  abstracts  where  we  are  using  free  text,  I  find  that  it  is 
not  unreasonable  to  expect  the  users  to  prepare  their  own  queries  with  some  encouragement.  I  agree  that  it 
does  take  considerably  more  computer  time  to  search. 

Are  these  terms  that  are  used  for  the  search  prepared  by  the  same  documental ists  that  are  preparing  the 
profiles?  Have  you  considered  the  time  used  by  the  documentalists  as  well  as  the  computer  time  in  the  total 
system  cost? 

Dr  Vernimb;  Our  relatively  small  team  of  specialists  started  with  indexing  but  it  was  found  necessary  to 

contract  out  this  work.  The  in-house  team  checks  the  outside  indexing  and  also  prepares  the  profiles  and  queries. 

Mme  Roeper,  France;  Ce  n' est  pas  exactement  uiie  questic.  nais  j' aimerais  revenir  sur  ce  qu’ a  dit  Dr  Vernimb. 

A  mon  sens  on  passe  le  temps  soit  a  1’ entrde  en  ordinateui  i.n  analysar.t  soigneusement  les  documents  et  on 
recupere  ce  temps  a  la  sortie  ou  alors  on  choisit  la  methcde  inverse,  et  a  mon  sens  les  deux  se  rejoignent  a 
moins  qu’ on  entre  simplement  des  documents  et  qu' on  veuille  jamais  repondre  aux  questions. 

Dr  Vernimb;  The  economy  of  this  procedure  is  a  function  of  the  nianber  of  documents  entered  and  the  number  of 
queries  asked.  In  our  system  with  a  yearly  input  of  100,000-120,000  documents,  we  use  about  eight  to  ten  minutes 
for  indexing  and  aoout  half  an  hour  for  query  formulation.  We  handle  a'  mt  one  thousand  queries  per  year  with 
our  small  staff  and  we  think  this  is  not  too  bad  from  an  economic  point  of  view.  With  the  relatively  small 
indexing  time,  we  think  that  it  is  an  economic  system. 

Mr  Dammers,  UK;  As  the  last  question  was  relevant  to  my  question.  I  would  like  to  pursue  it  further.  I  think 
it  is  wrong  to  evaluate  the  system  simply  on  the  basis  of  indexing  time  as  this  is  usually  underestimated.  I 
find  that  the  apparent  time  of  indexing  and  abstracting  does  not  account  for  the  full  time  of  the  staff. 

Apparently  more  time  per  document  should  be  allocated  for  a  realistic  accounting.  But  more  importantly,  one 
should  look  at  the  costs  of  the  total  system  and  this  should  include  the  user  as  well.  This  is  very  difficult 
to  quantify  but  one  should  consider  the  delays  suffered  by  the  user  and  how  easily  the  user  interacts  with  the 
system. 

With  regard  to  free  text,  very  few  of  us  would  say  that  one  should  put  in  full  text  that  which  is  still 
impractical.  Rather,  words  as  they  occur  in  the  text  should  be  freely  chosen  and  the  point  is  that  they  are 
the  natural  text  words  and  are  not  translated  into  words  which  have  fixed  and  determined  meanings.  Vocabulary 
systems  work  all.  right  as  long  as  the  indexers  also  formulate  the  questions.  This  means  that  the  translation 
and  deformation  occurring  in  input  is  allowed  for  at  the  output  but  is  very  difficult  to  guarantee  in  a  large 
organization. 

Dk  ernimb;  As  for  your  first  comment,  certainly  indexing  cannot  be  done  full  time.  Our  contract  indexers 
do  this  work  in  their  evenings  and  weekends  as  an  addition  to  their  regular  work  in  the  front  line  of  research 
in  their  speciality.  So  they  have  the  best  knowledge  in  the  field  and  are  well  equipped  for  indexing  after 
some  training  in  documentation. 


PAPER  No.  11  -  Mr  J.R. Buchanan 

Miss  Ironside,  Canada;  You  stressed  the  importance  of  using  technical  specialists  to  do  the  subject  cataloguing 
of  your  material,  would  you  enlarge  on  this  point,  are  they  employed  full  time  on  this  and  how  do  you  meet  the 
degree  of  specialization  requ  red? 

Mr  J.R. Buchanan;  They  are  bond;  scientists  and  engineers  who  are  active  in  their  field  and  for  this  reason  we 
are  content  to  put  up  with  some  of  the  problems  Inherent  in  dealing  with  part  time  staff.  The  clerical  staff 
is.  of  course,  full  time. 

Dr  Meivnr,  Canada;  Could  you  tell  us  if  your  system  is  based  on  individual  profiles  and.  if  so.  are  they 
prepared  by  the  user  or  by  specialists?  Is  it  based  on  a  thesaurus  or  on  free  text  searching  of  the  ■•.ostract? 
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Mr  J.R.Eachaaaii:  <K<;  have  a  theisaurus  aerentean  hundred  teraa.  About  one  third  of  the  profiles  are  based 
on  thesaurus  tent,...  Ihe  query  coaes  in  prose  fora  and  a  profile  is  developed  froa  thesaurus  terms  by  our 
specialists.  The  remainder  of  the  profiles  are  based  on  standard  categories.  Our  subject  field  is  divided 
into  twenty  categories  and  many  users  find  that  th(  .  interests  fit  into  these  categories.  There  is  provision 
for  feedback  tr.d  consequent  negating  of  some  teras  tn  these  categories. 

Also,  we  have  developed  specialized  profiles  that  cater  to  large  groups  of  users  such  as  the  instruoeiitation 
staffs  of  reactor  power  plants. 

Mr  Irvine,  Canada;  What  elements  of  infornation  are  stored  on  your  computer  and  how  is  it  inputted? 

Mr  J.R. Buchanan;  We  store  the  usual  bibliographic  information  -  the  author,  corporate  author,  miscellaneous 
information  on  number  of  pages  and  figures.  We  also  store  the  key  words  or  terms  from  the  thesaurus  aiid  a 
one-hundred  word  abstract. 

Until  about  three  months  ago  this  Information  was  inputted  to  the  computer  by  first  being  typed  on  a  conven¬ 
tional  typewriter  at  our  own  facility.  This  was  then  sent  ,;o  the  computer  facility  and  went  through  the  key 
punching  and  then  was  processed  into  our  master  tape  which  now  contains  about  35,000  items.  So  we  are  essentially 
a  small  mechanized  information  system. 

But  starting  in  June  we  converted  to  the  direct  Input  system  and  we  are  now  Inputting  via  a  CRT  device  so 
that  all  of  cur  references  are  now  being  entered,  proofed,  and  corrected  on  the  CRT.  They  are  then  dumped  into 
the  main  file  and  are  immediately  retrievable  by  remote  terminals  and  by  any  retrospective  searches  that  may 
be  run  at  the  computer  facility. 


